mradermacher/Deepseek-V2-13B-Math7K-Expert-Enhance-Subset-Expert-MoE-32-experts-i1-GGUF

Quantization vs HectorHe/Deepseek-V2-13B-Math7K-Expert-Enhance-Subset-Expert-MoE-32-experts. mradermacher/Deepseek-V2-13B-Math7K-Expert-Enhance-Subset-Expert-MoE-32-experts-i1-GGUF is a GGUF quantization (Q6_K) of the same weights: 108 tensors match exactly and 164 within quantization error.

Tensors changed: Embeddings 0/1, Norms 0/82, MLP 0/107, Attention 0/81, lm_head 0/1

On the Hub · Downloads on Model Pulse