Gille/StrangeMerges_49-7B-dare_ties

Full fine-tune vs AurelPx/Percival_01-7b-slerp. Fine-tune: 100% of the weights changed, across 32 of 32 layers.

Tensors changed: MLP 96/96, Attention 128/128, Norms 65/65, Embeddings 1/1, lm_head 1/1

3 derivatives checked

• mradermacher/StrangeMerges_49-7B-dare_ties-GGUF: Same weights, converted
• featherless-ai-quants/Gille-StrangeMerges_49-7B-dare_ties-GGUF: Quantization
• Gille/StrangeMerges_50-7B-slerp: Full fine-tune

On the Hub · Downloads on Model Pulse