reaperdoesntknow/Qwen3-0.6B-Distilled-30B-A3B

Partial fine-tune vs Qwen/Qwen3-0.6B. Partial change: 79% of the weights changed (attention, lm_head, mlp, norms), in 28 of 28 layers.

Tensors changed: lm_head 1/1, Embeddings 0/1, Norms 63/113, MLP 84/84, Attention 112/112

1 derivatives checked

• mradermacher/Qwen3-0.6B-Distilled-30B-A3B-GGUF: Same weights, converted

On the Hub · Downloads on Model Pulse