gratex/mistral-small-3.2-24b-Instruct-GPTQ-W4A16
Quantization vs mistralai/Mistral-Small-3.2-24B-Instruct-2506. gratex/mistral-small-3.2-24b-Instruct-GPTQ-W4A16 is a quantized version of the other (I32/BF16).
Quantization vs mistralai/Mistral-Small-3.2-24B-Instruct-2506. gratex/mistral-small-3.2-24b-Instruct-GPTQ-W4A16 is a quantized version of the other (I32/BF16).