MergeFuel/Miquliz-120b-137l
Partial fine-tune (fewer layers) vs 152334H/miqu-1-70b-sf. 152334H/miqu-1-70b-sf matches part of MergeFuel/Miquliz-120b-137l (723 of its 1236 tensors; the rest of MergeFuel/Miquliz-120b-137l has no counterpart). On the shared part: Partial change: 79% of the weights changed (attention, mlp, norms), in 64 of 80 layers.
Tensors changed: Embeddings 0/1, Norms 128/161, MLP 192/240, Attention 256/320, lm_head 0/1
1 derivatives checked
- mradermacher/Miquliz-120b-137l-i1-GGUF: Quantization