Zyphra/Zamba2-VL-1.2B

Full fine-tune (fewer layers) vs Zyphra/Zamba2-1.2B. Zyphra/Zamba2-1.2B matches part of Zyphra/Zamba2-VL-1.2B (405 of its 796 tensors; the rest of Zyphra/Zamba2-VL-1.2B has no counterpart). On the shared part: Fine-tune: 100% of the weights changed, across 38 of 38 layers.

Tensors changed: Norms 79/79, other 263/272, MLP 14/14, Attention 40/40

On the Hub · Downloads on Model Pulse