kataguru/TranslateGemma-27B-Finnish-W4A16-AWQ

Quantization vs google/translategemma-27b-it. kataguru/TranslateGemma-27B-Finnish-W4A16-AWQ is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse