TheBloke/Nous-Hermes-2-Mixtral-8x7B-SFT-GPTQ

Quantization vs NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT. TheBloke/Nous-Hermes-2-Mixtral-8x7B-SFT-GPTQ is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse