Lythri/Lythri-4B-A2B-Q4_0_8-GGUF
Quantization vs Lythri/Lythri-4B-A2B. Lythri/Lythri-4B-A2B-Q4_0_8-GGUF is a GGUF quantization (Q4_0_8) of the same weights: 228 tensors match exactly and 277 within quantization error.
Tensors changed: Embeddings 0/2, Norms 0/227, MLP 0/105, other 0/71, Attention 0/100