graelo/Qwen2.5-7B-Instruct-1M-AWQ

Quantization vs Qwen/Qwen2.5-7B-Instruct-1M. graelo/Qwen2.5-7B-Instruct-1M-AWQ is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse