Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound
Quantization vs mistralai/Mistral-Small-3.2-24B-Instruct-2506. Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound is a quantized version of the other (I32/BF16).
Quantization vs mistralai/Mistral-Small-3.2-24B-Instruct-2506. Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound is a quantized version of the other (I32/BF16).