qingy2024/Pristine-8B-A1B

Full fine-tune vs LiquidAI/LFM2-8B-A1B. Fine-tune: 100% of the weights changed, across 24 of 24 layers.

Tensors changed: MLP 2140/2162, Embeddings 2/2, other 54/54, Norms 50/60, Attention 24/24

2 derivatives checked

On the Hub · Downloads on Model Pulse