liodon-ai/bloomz-560m-imatrix-GGUF
Quantization vs bigscience/bloomz-560m. liodon-ai/bloomz-560m-imatrix-GGUF is a GGUF quantization (Q8_0) of the same weights: 172 tensors match exactly and 73 within quantization error.
Tensors changed: Norms 0/98, MLP 0/96, Attention 0/48, Embeddings 0/3