mlabonne/Qwen3-4B-abliterated

Abliterated vs Qwen/Qwen3-4B. Looks like abliteration (refusal removal): only the output projections (down_proj, o_proj) changed, in 36 of 36 layers. Abliteration edits exactly these matrices to remove a "refusal direction"; everything else is untouched.

Tensors changed: Embeddings 0/1, Norms 0/145, MLP 36/108, Attention 36/144

10 derivatives checked

1 other repos hold byte-for-byte identical weight files.

On the Hub · Downloads on Model Pulse