nbeerbower/Mahou-1.5-mistral-nemo-12B-lorablated

Partial fine-tune vs flammenai/Mahou-1.5-mistral-nemo-12B. Partial change: 53% of the weights changed (attention, embeddings, lm_head, mlp, norms), in 40 of 40 layers.

Tensors changed: Embeddings 1/1, Norms 50/81, MLP 55/120, Attention 69/160, lm_head 1/1

18 derivatives checked

On the Hub · Downloads on Model Pulse