ThatCultivator/sarvam-30b-Uncensored-gguf

Quantization vs aoxo/sarvam-30b-uncensored. ThatCultivator/sarvam-30b-Uncensored-gguf is a GGUF quantization (Q6_K) of the same weights: 95 tensors match exactly and 78 within quantization error.

Tensors changed: Attention 0/19, Norms 0/77, MLP 0/75, Embeddings 0/1, lm_head 0/1

On the Hub · Downloads on Model Pulse