mlx-community/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-4bit

Quantization vs Goekdeniz-Guelmez/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1. mlx-community/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-4bit is a quantized version of the other (U32/F16).

On the Hub · Downloads on Model Pulse