mlx-community/Voxtral-Mini-4B-Realtime-6bit

Quantization vs mistralai/Voxtral-Mini-4B-Realtime-2602. mlx-community/Voxtral-Mini-4B-Realtime-6bit is a quantized version of the other (U32/BF16).

On the Hub · Downloads on Model Pulse