Quantization vs tencent/Hy3. AngelSlim/Hy3-GPTQ-Int4 is a quantized version of the other (I32/BF16).
On the Hub · Downloads on Model Pulse