Darkknight535/Patricide-21B-Unslop-Mell
Partial fine-tune (fewer layers) vs redrix/patricide-12B-Unslop-Mell. redrix/patricide-12B-Unslop-Mell matches part of Darkknight535/Patricide-21B-Unslop-Mell (363 of its 633 tensors; the rest of Darkknight535/Patricide-21B-Unslop-Mell has no counterpart). On the shared part: Partial change: 22% of the weights changed (attention, mlp, norms), in 10 of 40 layers.
Tensors changed: lm_head 0/1, Embeddings 0/1, Norms 20/81, MLP 30/120, Attention 40/160
3 derivatives checked
- mradermacher/Patricide-21B-Unslop-Mell-i1-GGUF: Quantization
- mradermacher/Patricide-21B-Unslop-Mell-GGUF: Quantization
- Darkknight535/Theia-Unslop-Mell-21B: Full fine-tune