OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-gptq-sym
Quantization vs mistralai/Mistral-Small-3.1-24B-Instruct-2503. OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-gptq-sym is a quantized version of the other (I32/BF16).
Quantization vs mistralai/Mistral-Small-3.1-24B-Instruct-2503. OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-gptq-sym is a quantized version of the other (I32/BF16).