mlx-community/granite-3.3-2b-instruct-4bit

Quantization vs ibm-granite/granite-3.3-2b-instruct. mlx-community/granite-3.3-2b-instruct-4bit is a quantized version of the other (U32/F16).

On the Hub · Downloads on Model Pulse