casperhansen/mistral-nemo-instruct-2407-awq

Quantization vs mistralai/Mistral-Nemo-Instruct-2407. casperhansen/mistral-nemo-instruct-2407-awq is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse