Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4
Quantization vs Qwen/Qwen2.5-0.5B-Instruct. Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4 is a quantized version of the other (F16/I32).
2 other repos hold byte-for-byte identical weight files.
Quantization vs Qwen/Qwen2.5-0.5B-Instruct. Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4 is a quantized version of the other (F16/I32).
2 other repos hold byte-for-byte identical weight files.