moot20/Dolphin3.0-Mistral-24B-MLX-8bits

Quantization vs dphn/Dolphin3.0-Mistral-24B. moot20/Dolphin3.0-Mistral-24B-MLX-8bits is a quantized version of the other (U32/F16).

On the Hub · Downloads on Model Pulse