cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-8bit

Quantization vs moonshotai/Kimi-Linear-48B-A3B-Instruct. cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-8bit is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse