MoonRide/gemma-4-12B-it-heretic

Abliterated vs google/gemma-4-12B-it. Looks like abliteration (refusal removal): only the output projections (down_proj, o_proj) changed, in 31 of 48 layers. Abliteration edits exactly these matrices to remove a "refusal direction"; everything else is untouched.

Tensors changed: Embeddings 0/12, Norms 0/289, other 0/48, MLP 21/144, Attention 31/184

1 derivatives checked

On the Hub · Downloads on Model Pulse