grayarea/gemma-3-4b-it-heretic-v1.2
Abliterated vs google/gemma-3-4b-it. Looks like abliteration (refusal removal): only the output projections (down_proj, o_proj) changed, in 31 of 34 layers. Abliteration edits exactly these matrices to remove a "refusal direction"; everything else is untouched.
Tensors changed: Embeddings 0/4, Norms 0/316, MLP 26/210, Attention 31/352, other 0/1
3 derivatives checked
- mradermacher/gemma-3-4b-it-heretic-v1.2-i1-GGUF: Quantization (fewer layers)
- mradermacher/gemma-3-4b-it-heretic-v1.2-GGUF: Same weights, converted (fewer layers)
- grayarea/gemma-3-4b-it-heretic-v1.2-GGUF: Same weights, converted (fewer layers)