mlx-community/starcoder2-15b-instruct-v0.1-4bit

Quantization vs bigcode/starcoder2-15b. mlx-community/starcoder2-15b-instruct-v0.1-4bit is a quantized version of the other (U32/F16).

On the Hub · Downloads on Model Pulse