Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4
Quantization vs Qwen/Qwen2.5-Coder-32B-Instruct. Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4 is a quantized version of the other (I32/F16).
1 other repos hold byte-for-byte identical weight files.
Quantization vs Qwen/Qwen2.5-Coder-32B-Instruct. Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4 is a quantized version of the other (I32/F16).
1 other repos hold byte-for-byte identical weight files.