Quantization vs sarvamai/sarvam-30b. QuantTrio/sarvam-30b-AWQ is a quantized version of the other (I32/F32).
On the Hub · Downloads on Model Pulse