Quantization vs rinna/youri-7b-chat. rinna/youri-7b-chat-gptq is a quantized version of the other (I32/F16).
On the Hub · Downloads on Model Pulse