RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Quantization vs mistralai/Mistral-7B-Instruct-v0.3. RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit is a quantized version of the other (I32/F16).
1 other repos hold byte-for-byte identical weight files.
Quantization vs mistralai/Mistral-7B-Instruct-v0.3. RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit is a quantized version of the other (I32/F16).
1 other repos hold byte-for-byte identical weight files.