sail/Sailor2-1B

Full fine-tune (fewer layers) vs Qwen/Qwen2.5-0.5B. Qwen/Qwen2.5-0.5B matches part of sail/Sailor2-1B (290 of its 579 tensors; the rest of sail/Sailor2-1B has no counterpart). On the shared part: Fine-tune: 100% of the weights changed, across 24 of 24 layers.

Tensors changed: Embeddings 1/1, Norms 49/49, MLP 72/72, Attention 168/168

13 derivatives checked

On the Hub · Downloads on Model Pulse