mradermacher/OLMo-2-1124-13B-Instruct-32k-Context-ChatML-GGUF

Quantization vs sp-embraceable/OLMo-2-1124-13B-Instruct-32k-Context-ChatML. mradermacher/OLMo-2-1124-13B-Instruct-32k-Context-ChatML-GGUF is a GGUF quantization (Q8_0) of the same weights: 161 tensors match exactly and 282 within quantization error.

Tensors changed: Embeddings 0/1, MLP 0/120, Norms 0/161, Attention 0/160, lm_head 0/1

On the Hub · Downloads on Model Pulse