open-athena/Grug-67B-A2B-Datakit-SFT-262K-2026.09.21-dr-doom

Full fine-tune vs open-athena/Grug-67B-A2B-Datakit-SFT-262K-2026.09.21. Fine-tune: 92% of the weights changed, across 26 of 26 layers.

Tensors changed: lm_head 1/1, Embeddings 2/4, Norms 106/159, MLP 173/208, Attention 130/130

1 derivatives checked

On the Hub · Downloads on Model Pulse