cyankiwi/gemma-4-31B-it-qat-AWQ-INT4

Quantization vs google/gemma-4-31B-it-qat-q4_0-unquantized. cyankiwi/gemma-4-31B-it-qat-AWQ-INT4 is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse