lmstudio-community/gemma-4-12B-it-QAT-GGUF

Quantization vs google/gemma-4-12B-it-qat-q4_0-unquantized. lmstudio-community/gemma-4-12B-it-QAT-GGUF is a GGUF quantization (Q4_0) of the same weights: 289 tensors match exactly and 329 within quantization error.

Tensors changed: Embeddings 0/1, Norms 0/289, MLP 0/144, Attention 0/184

2 derivatives checked

On the Hub · Downloads on Model Pulse