Lythri/Lythri-4B-A2B-GGUF

Quantization vs Lythri/Lythri-4B-A2B. Lythri/Lythri-4B-A2B-GGUF is a GGUF quantization (Q8_0) of the same weights: 228 tensors match exactly and 277 within quantization error.

Tensors changed: Embeddings 0/2, Norms 0/227, MLP 0/105, other 0/71, Attention 0/100

On the Hub · Downloads on Model Pulse