styal/SmolLM2-135M-layertrop-topk-k3
Full fine-tune vs HuggingFaceTB/SmolLM2-135M-Instruct. Fine-tune: 100% of the weights changed, across 30 of 30 layers.
Tensors changed: Embeddings 1/1, Norms 61/61, MLP 90/90, Attention 120/120
Full fine-tune vs HuggingFaceTB/SmolLM2-135M-Instruct. Fine-tune: 100% of the weights changed, across 30 of 30 layers.
Tensors changed: Embeddings 1/1, Norms 61/61, MLP 90/90, Attention 120/120