robinzixuan/vanilla_llama3.2_1b_6k
Full fine-tune (fewer layers) vs meta-llama/Llama-3.2-1B. meta-llama/Llama-3.2-1B matches part of robinzixuan/vanilla_llama3.2_1b_6k (146 of its 242 tensors; the rest of robinzixuan/vanilla_llama3.2_1b_6k has no counterpart). On the shared part: Fine-tune: 100% of the weights changed, across 16 of 16 layers.
Tensors changed: Embeddings 1/1, Norms 33/33, MLP 48/48, Attention 64/64