unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit
Quantization vs mistralai/Mistral-Small-24B-Instruct-2501. unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit is a quantized version of the other (U8/BF16).
4 derivatives checked
- MeerDevelopment/Mistral-Small-24B-Instruct-2501-Dutch-GGUF: Quantization
- AlSamCur123/Mistral-24BContinued: Quantization
- AlSamCur123/Mistral-Small-24B-Instruct-2501-continued: Quantization
- seacorn/Mistral-Small-24B-Instruct-2501-Reasoner: Quantization