Quantization vs tencent/Hy-MT2-7B. shawnw3i/Hy-MT2-7B-AWQ is a quantized version of the other (I32/BF16).
On the Hub · Downloads on Model Pulse