robinzixuan/s0_softmax1_noroute_llama3.2_1b
Full fine-tune (fewer layers) vs meta-llama/Llama-3.2-1B. meta-llama/Llama-3.2-1B matches part of robinzixuan/s0_softmax1_noroute_llama3.2_1b (146 of its 242 tensors; the rest of robinzixuan/s0_softmax1_noroute_llama3.2_1b has no counterpart). On the shared part: Fine-tune: 100% of the weights changed, across 16 of 16 layers.
Tensors changed: Embeddings 1/1, Norms 33/33, MLP 48/48, Attention 64/64