Intel/Hy-MT2-7B-int4-AutoRound
Quantization vs tencent/Hy-MT2-7B. Intel/Hy-MT2-7B-int4-AutoRound is a quantized version of the other (I32/BF16).
Quantization vs tencent/Hy-MT2-7B. Intel/Hy-MT2-7B-int4-AutoRound is a quantized version of the other (I32/BF16).