dphn/dolphin-2.9.1-qwen-110b

Partial fine-tune vs Qwen/Qwen1.5-110B. Partial change: 51% of the weights changed (attention, embeddings, lm_head, mlp, norms), in 80 of 80 layers.

Tensors changed: Embeddings 1/1, Norms 80/161, MLP 120/240, Attention 280/560, lm_head 1/1

2 derivatives checked

On the Hub · Downloads on Model Pulse