chris320211/smoothquant-qwen25-15b-g52xlarge

Quantization vs Qwen/Qwen2.5-1.5B-Instruct. chris320211/smoothquant-qwen25-15b-g52xlarge is a quantized version of the other (I8/F16).

On the Hub · Downloads on Model Pulse