drawais/Qwen2.5-32B-Instruct-AWQ-INT4

Quantization vs Qwen/Qwen2.5-32B-Instruct. drawais/Qwen2.5-32B-Instruct-AWQ-INT4 is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse