Baekpica/IQuest-Q1-Mixed-Quant-GGUF

Quantization vs IQuestLab/IQuest-Q1. Baekpica/IQuest-Q1-Mixed-Quant-GGUF is a GGUF quantization (IQ2_XXS) of the same weights: 352 tensors match exactly and 357 within quantization error.

Tensors changed: Attention 0/352, MLP 0/90, Norms 0/265, Embeddings 0/1, lm_head 0/1

On the Hub · Downloads on Model Pulse