qthans/Qwen2.5-0.5B-OBLITERATED

Partial fine-tune vs Qwen/Qwen2.5-0.5B. Partial change: 40% of the weights changed (attention, embeddings, mlp), in 4 of 24 layers.

Tensors changed: Embeddings 1/1, Norms 0/49, MLP 12/72, Attention 16/168

2 derivatives checked

On the Hub · Downloads on Model Pulse