Sorihon/Celestial-Queen-12B-Heretic-V2
Abliterated vs Vortex5/Celestial-Queen-12B. Looks like abliteration (refusal removal): only the output projections (down_proj, o_proj) changed, in 38 of 40 layers. Abliteration edits exactly these matrices to remove a "refusal direction"; everything else is untouched.
Tensors changed: lm_head 0/1, Embeddings 0/1, Norms 0/81, MLP 38/120, Attention 33/160
2 derivatives checked
- mradermacher/Celestial-Queen-12B-Heretic-V2-i1-GGUF: Quantization
- mradermacher/Celestial-Queen-12B-Heretic-V2-GGUF: Quantization