mradermacher/LLama-3-Dolphin-2.9.1-120b-GGUF

Quantization vs DarqueDante/LLama-3-Mega-Dolphin-2.9.1-120b. mradermacher/LLama-3-Dolphin-2.9.1-120b-GGUF is a GGUF quantization (Q2_K) of the same weights: 281 tensors match exactly and 982 within quantization error.

Tensors changed: lm_head 0/1, Embeddings 0/1, Norms 0/281, MLP 0/420, Attention 0/560

On the Hub · Downloads on Model Pulse