TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ
Quantization vs NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO. TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ is a quantized version of the other (I32/F16).
Quantization vs NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO. TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ is a quantized version of the other (I32/F16).