Mincofficial/Sonoma-1.2B-Preview
Partial fine-tune vs LiquidAI/LFM2.5-1.2B-Thinking. Partial change: 89% of the weights changed (attention, mlp, other), in 16 of 16 layers.
Tensors changed: Embeddings 0/2, other 20/20, MLP 48/48, Norms 0/44, Attention 24/24
1 derivatives checked
- Mincofficial/Sonoma-1.2B-0901: Partial fine-tune