lewtun/tailsft-repro-smoke-std
Partial fine-tune vs allenai/OLMo-2-0425-1B. Partial change: 72% of the weights changed (attention, mlp, norms), in 16 of 16 layers.
Tensors changed: Embeddings 0/1, MLP 48/48, Norms 39/65, Attention 64/64, lm_head 0/1
Partial fine-tune vs allenai/OLMo-2-0425-1B. Partial change: 72% of the weights changed (attention, mlp, norms), in 16 of 16 layers.
Tensors changed: Embeddings 0/1, MLP 48/48, Norms 39/65, Attention 64/64, lm_head 0/1