Quantization vs tencent/Hy3. canada-quant/hy3-w4a16-mtp is a quantized version of the other (I32/BF16).
On the Hub · Downloads on Model Pulse