mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT

Quantization vs allenai/Olmo-3-7B-Instruct. mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT is a quantized version of the other (U32/U8).

On the Hub · Downloads on Model Pulse