mlx-community/Cydonia-24B-v3-4bit

Quantization vs TheDrummer/Cydonia-24B-v3. mlx-community/Cydonia-24B-v3-4bit is a quantized version of the other (U32/BF16).

On the Hub · Downloads on Model Pulse