tensorblock/Guanaco-3B-Uncensored-v2-GGUF

Quantization vs Fredithefish/Guanaco-3B-Uncensored-v2. tensorblock/Guanaco-3B-Uncensored-v2-GGUF is a GGUF quantization (Q3_K_M) of the same weights: 226 tensors match exactly and 98 within quantization error.

Tensors changed: Embeddings 0/2, Norms 0/130, Attention 0/64, MLP 0/128

On the Hub · Downloads on Model Pulse