mlx-community/gemma-3-12b-it-qat-abliterated-lm-4bit

Quantization vs mlabonne/gemma-3-12b-it-qat-abliterated. mlx-community/gemma-3-12b-it-qat-abliterated-lm-4bit is a quantized version of the other (U32/F32).

On the Hub · Downloads on Model Pulse