KaraKaraWarehouse/UnFimbulvetr-20B
Partial fine-tune (fewer layers) vs Sao10K/Fimbulvetr-11B-v2. Sao10K/Fimbulvetr-11B-v2 matches part of KaraKaraWarehouse/UnFimbulvetr-20B (435 of its 813 tensors; the rest of KaraKaraWarehouse/UnFimbulvetr-20B has no counterpart). On the shared part: Partial change: 71% of the weights changed (attention, mlp, norms), in 35 of 48 layers.
Tensors changed: Embeddings 0/1, Norms 70/97, MLP 105/144, Attention 140/192, lm_head 0/1
1 derivatives checked
- mradermacher/UnFimbulvetr-20B-GGUF: Quantization