mlx-community/Fara1.5-27B-OptiQ-4bit

Quantization vs microsoft/Fara1.5-27B. mlx-community/Fara1.5-27B-OptiQ-4bit is a quantized version of the other (U32/F32).

On the Hub · Downloads on Model Pulse