allenai/Bolmo-1B-Stage1
Partial fine-tune (fewer layers) vs allenai/OLMo-2-0425-1B. allenai/OLMo-2-0425-1B matches part of allenai/Bolmo-1B-Stage1 (177 of its 263 tensors; the rest of allenai/Bolmo-1B-Stage1 has no counterpart). On the shared part: Partial change: 0% of the weights changed (norms), in 0 of 16 layers.
Tensors changed: MLP 0/48, Norms 1/65, Attention 0/64
1 derivatives checked
- allenai/Bolmo-1B: Full fine-tune