KaraKaraWarehouse/UnFimbulvetr-20B-V2
Partial fine-tune (fewer layers) vs Sao10K/Fimbulvetr-11B-v2. Sao10K/Fimbulvetr-11B-v2 matches part of KaraKaraWarehouse/UnFimbulvetr-20B-V2 (435 of its 849 tensors; the rest of KaraKaraWarehouse/UnFimbulvetr-20B-V2 has no counterpart). On the shared part: Partial change: 71% of the weights changed (attention, mlp, norms), in 35 of 48 layers.
Tensors changed: Embeddings 0/1, Norms 70/97, MLP 105/144, Attention 140/192, lm_head 0/1
2 derivatives checked
- mradermacher/UnFimbulvetr-20B-V2-i1-GGUF: Quantization
- mradermacher/UnFimbulvetr-20B-V2-GGUF: Quantization