mmnga/RakutenAI-2.0-mini-instruct-gguf

Quantization vs Rakuten/RakutenAI-2.0-mini-instruct. mmnga/RakutenAI-2.0-mini-instruct-gguf is a GGUF quantization (Q8_0) of the same weights: 45 tensors match exactly and 156 within quantization error.

Tensors changed: lm_head 0/1, Embeddings 0/1, Norms 0/45, MLP 0/66, Attention 0/88

On the Hub · Downloads on Model Pulse