SvalTek/ColdBrew-Indium

Partial fine-tune (fewer layers) vs SvalTek/ColdBrew-Aphid. SvalTek/ColdBrew-Aphid matches part of SvalTek/ColdBrew-Indium (255 of its 372 tensors; the rest of SvalTek/ColdBrew-Indium has no counterpart). On the shared part: Partial change: 33% of the weights changed (attention, mlp, norms), in 12 of 28 layers.

Tensors changed: Embeddings 0/1, Norms 24/57, MLP 36/84, Attention 48/112, lm_head 0/1

1 derivatives checked

On the Hub · Downloads on Model Pulse