Grogros/OLMo-2-0425-1B-Instruct-distillation-wildchat-alpaca-5.0-AlpacaPoison-4k

Full fine-tune vs allenai/OLMo-2-0425-1B-Instruct. Fine-tune: 100% of the weights changed, across 16 of 16 layers.

Tensors changed: lm_head 1/1, Embeddings 1/1, MLP 48/48, Norms 63/65, Attention 64/64

1 derivatives checked

On the Hub · Downloads on Model Pulse