mradermacher/LFM2.5-Queen-8B-A1B-i1-GGUF

Quantization vs aifeifei798/LFM2.5-Queen-8B-A1B. mradermacher/LFM2.5-Queen-8B-A1B-i1-GGUF is a GGUF quantization (Q6_K) of the same weights: 83 tensors match exactly and 67 within quantization error.

Tensors changed: Embeddings 0/2, other 0/36, MLP 0/28, Norms 0/60, Attention 0/24

On the Hub · Downloads on Model Pulse