mlx-community/Midnight-Miqu-70B-v1.5-MLX-8Bit

Quantization vs sophosympatheia/Midnight-Miqu-70B-v1.5. mlx-community/Midnight-Miqu-70B-v1.5-MLX-8Bit is a quantized version of the other (U32/F16).

On the Hub · Downloads on Model Pulse