mlx-community/Devstral-Small-2505-4bit-DWQ

Quantization vs mlx-community/Devstral-Small-2505-bf16. mlx-community/Devstral-Small-2505-4bit-DWQ is a quantized version of the other (U32/BF16).

On the Hub · Downloads on Model Pulse