kykim0/pythia-1b-tulu-v2-mix

Full fine-tune vs EleutherAI/pythia-1b. Fine-tune: 100% of the weights changed, across 16 of 16 layers.

Tensors changed: Embeddings 2/2, Norms 33/66, Attention 64/64, MLP 64/64

1 derivatives checked

On the Hub · Downloads on Model Pulse