invisietch/AtlantisMix-21B
Full fine-tune (fewer layers) vs MarinaraSpaghetti/NemoMix-Unleashed-12B. MarinaraSpaghetti/NemoMix-Unleashed-12B matches part of invisietch/AtlantisMix-21B (363 of its 633 tensors; the rest of invisietch/AtlantisMix-21B has no counterpart). On the shared part: Fine-tune: 95% of the weights changed, across 40 of 40 layers.
Tensors changed: lm_head 0/1, Embeddings 1/1, Norms 55/81, MLP 120/120, Attention 160/160
2 derivatives checked
- mradermacher/AtlantisMix-21B-i1-GGUF: Quantization
- mradermacher/AtlantisMix-21B-GGUF: Quantization