Naphula/Goetia-26B-A4B-v1.5
Full fine-tune (fewer layers) vs ApocalypseParty/G4-26B-SFT-6. Naphula/Goetia-26B-A4B-v1.5 matches part of ApocalypseParty/G4-26B-SFT-6 (662 of its 1013 tensors; the rest of ApocalypseParty/G4-26B-SFT-6 has no counterpart). On the shared part: Fine-tune: 100% of the weights changed, across 30 of 30 layers.
Tensors changed: Embeddings 4/4, MLP 150/150, Norms 89/271, other 30/122, Attention 115/115
2 derivatives checked
- mradermacher/Goetia-26B-A4B-v1.5-i1-GGUF: Quantization
- mradermacher/Goetia-26B-A4B-v1.5-GGUF: Quantization