McG-221/Sketch-Cydonia-24B-V1.2-mlx-8Bit

Quantization vs Ateron/Sketch-Cydonia-24B-V1.2. McG-221/Sketch-Cydonia-24B-V1.2-mlx-8Bit is a quantized version of the other (U32/BF16).

On the Hub · Downloads on Model Pulse