mergekit-community/mergekit-linear-iwfvdmg
Partial fine-tune vs SicariusSicariiStuff/Nano_Imp_1B. Partial change: 82% of the weights changed (attention, embeddings, mlp), in 16 of 16 layers.
Tensors changed: lm_head 0/1, Embeddings 1/1, Norms 0/33, MLP 48/48, Attention 64/64
1 derivatives checked
- mradermacher/mergekit-linear-iwfvdmg-GGUF: Same weights, converted