heretic-org/gemma-3-4b-it-heretic
Abliterated vs google/gemma-3-4b-it. Looks like abliteration (refusal removal): only the output projections (down_proj, o_proj) changed, in 26 of 34 layers. Abliteration edits exactly these matrices to remove a "refusal direction"; everything else is untouched.
Tensors changed: Embeddings 0/4, Norms 0/316, MLP 23/210, Attention 26/352, other 0/1
1 derivatives checked
- SimplySara/gemma-3-4b-it-heretic-i1-GGUF: Quantization (fewer layers)