Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4
Quantization vs Qwen/Qwen2.5-72B-Instruct. Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4 is a quantized version of the other (I32/F16).
2 other repos hold byte-for-byte identical weight files.
Quantization vs Qwen/Qwen2.5-72B-Instruct. Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4 is a quantized version of the other (I32/F16).
2 other repos hold byte-for-byte identical weight files.