mlabonne/FrankenMonarch-11b
Full fine-tune (fewer layers) vs mlabonne/AlphaMonarch-7B. mlabonne/AlphaMonarch-7B matches part of mlabonne/FrankenMonarch-11b (291 of its 435 tensors; the rest of mlabonne/FrankenMonarch-11b has no counterpart). On the shared part: Fine-tune: 96% of the weights changed, across 32 of 32 layers.
Tensors changed: Embeddings 0/1, Norms 16/65, MLP 96/96, Attention 128/128, lm_head 0/1
1 derivatives checked
- mradermacher/FrankenMonarch-11b-GGUF: Quantization