IFM/K2-Type-0.9B
Full fine-tune vs IFM/K2-Horizon-0.9B. Fine-tune: 91% of the weights changed, across 28 of 28 layers.
Tensors changed: lm_head 0/1, Embeddings 1/1, Norms 1/57, MLP 84/84, Attention 112/112
Full fine-tune vs IFM/K2-Horizon-0.9B. Fine-tune: 91% of the weights changed, across 28 of 28 layers.
Tensors changed: lm_head 0/1, Embeddings 1/1, Norms 1/57, MLP 84/84, Attention 112/112