Felladrin/gguf-q5_k_m-h2o-danube3-500m-chat

Quantization vs h2oai/h2o-danube3-500m-chat. Felladrin/gguf-q5_k_m-h2o-danube3-500m-chat is a GGUF quantization (Q5_K/Q6_K) of the same weights: 33 tensors match exactly and 114 within quantization error.

Tensors changed: lm_head 0/1, Embeddings 0/1, Norms 0/33, MLP 0/48, Attention 0/64

On the Hub · Downloads on Model Pulse