ProCreations/grug-35b-qat-q4-gguf
Quantization vs ProCreations/grug-35b-v2. ProCreations/grug-35b-qat-q4-gguf is a GGUF quantization (Q4_K_M) of the same weights: 141 tensors match exactly and 162 within quantization error.
Tensors changed: lm_head 0/1, Embeddings 0/1, Norms 0/101, MLP 0/160, Attention 0/40