featherless-ai-quants/xw17-TinyLlama-1.1B-Chat-v1.0_finetuned_4-GGUF

Quantization vs xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_4. featherless-ai-quants/xw17-TinyLlama-1.1B-Chat-v1.0_finetuned_4-GGUF is a GGUF quantization (Q8_0) of the same weights: 45 tensors match exactly and 156 within quantization error.

Tensors changed: lm_head 0/1, Embeddings 0/1, Norms 0/45, MLP 0/66, Attention 0/88

On the Hub · Downloads on Model Pulse