empero-ai/Qwen3.8-4B-Distill

Full fine-tune vs Qwen/Qwen3.5-4B. Fine-tune: 90% of the weights changed, across 32 of 32 layers.

Tensors changed: Embeddings 1/5, MLP 96/199, Attention 177/324, Norms 51/209, other 0/1

27 derivatives checked

On the Hub · Downloads on Model Pulse