laion/snowball-67b-a2b-rl-r2egym-newstack-step24

Full fine-tune vs laion/snowball-67b-a2b-sft-s3-nemotron-terminal-step1888. Fine-tune: 100% of the weights changed, across 26 of 26 layers.

Tensors changed: lm_head 1/1, Embeddings 3/4, Norms 146/159, MLP 182/208, Attention 130/130

On the Hub · Downloads on Model Pulse