mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit
Quantization vs Kwaipilot/KAT-Coder-V2.5-Dev. mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit is a quantized version of the other (U32/BF16).
3 derivatives checked
- mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit-REAP-18B: Same weights, repacked
- sluttybutfast/KAT-Coder-V2.5-Dev-Vision-OptiQ-4bit: Same weights, repacked
- npario/KAT-Coder-V2.5-Dev-Vision-OptiQ-4bit: Same weights, repacked