QuantFactory/GRMR-2B-Instruct-old-GGUF

Quantization vs unsloth/gemma-2-2b-bnb-4bit. unsloth/gemma-2-2b-bnb-4bit is a quantized version of the other (BF16/U8).

On the Hub · Downloads on Model Pulse