DarkKitsune/LFM2.5-8B-A1B-Opus-Distil-Q5_K_M-imat-GGUF

Quantization vs reaperdoesntknow/LFM2.5-8B-A1B-Opus-Distil. DarkKitsune/LFM2.5-8B-A1B-Opus-Distil-Q5_K_M-imat-GGUF is a GGUF quantization (Q5_K/Q6_K) of the same weights: 83 tensors match exactly and 67 within quantization error.

Tensors changed: Embeddings 0/2, other 0/36, MLP 0/28, Norms 0/60, Attention 0/24

On the Hub · Downloads on Model Pulse