oxfrug/Ornith-1.5-35B-A3B-REAP-20pct

Partial fine-tune vs ornith-ai/Ornith-1.5-35B-A3B. Partial change: 23% of the weights changed (attention, embeddings, mlp, norms, other), in 1 of 40 layers.

Tensors changed: Embeddings 1/5, Norms 6/247, Attention 4/392, MLP 773/1045, lm_head 0/1, other 1/1

On the Hub · Downloads on Model Pulse