win10/MagpieLM-8B
Partial fine-tune (fewer layers) vs Magpie-Align/MagpieLM-4B-Chat-v0.1. Magpie-Align/MagpieLM-4B-Chat-v0.1 matches part of win10/MagpieLM-8B (291 of its 552 tensors; the rest of win10/MagpieLM-8B has no counterpart). On the shared part: Partial change: 77% of the weights changed (attention, mlp, norms), in 30 of 32 layers.
Tensors changed: Embeddings 0/1, Norms 60/65, MLP 90/96, Attention 120/128, lm_head 0/1
2 derivatives checked
- mradermacher/MagpieLM-8B-i1-GGUF: Quantization
- mradermacher/MagpieLM-8B-GGUF: Same weights, converted