MuXodious/gemma-4-E4B-it-QAT-SOMPOA-heresy
Abliterated vs google/gemma-4-E4B-it-qat-q4_0-unquantized. Looks like abliteration (refusal removal): only the output projections (down_proj, o_proj) changed, in 36 of 42 layers. Abliteration edits exactly these matrices to remove a "refusal direction"; everything else is untouched.
Tensors changed: MLP 36/606, Norms 0/484, other 0/261, Attention 29/719, Embeddings 0/6
2 derivatives checked
- mradermacher/gemma-4-E4B-it-QAT-SOMPOA-heresy-i1-GGUF: Quantization (fewer layers)
- mradermacher/gemma-4-E4B-it-QAT-SOMPOA-heresy-GGUF: Same weights, converted (fewer layers)