Columbidae/gemma-2-4b-it-upscaled

Partial fine-tune (fewer layers) vs unsloth/gemma-2-2b-it. unsloth/gemma-2-2b-it matches part of Columbidae/gemma-2-4b-it-upscaled (288 of its 464 tensors; the rest of Columbidae/gemma-2-4b-it-upscaled has no counterpart). On the shared part: Partial change: 33% of the weights changed (attention, mlp, norms), in 11 of 26 layers.

Tensors changed: Embeddings 0/1, Norms 44/105, MLP 33/78, Attention 44/104

On the Hub · Downloads on Model Pulse