TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Quantization vs mistralai/Mistral-7B-Instruct-v0.2. TheBloke/Mistral-7B-Instruct-v0.2-GPTQ is a quantized version of the other (I32/BF16).
2 other repos hold byte-for-byte identical weight files.
Quantization vs mistralai/Mistral-7B-Instruct-v0.2. TheBloke/Mistral-7B-Instruct-v0.2-GPTQ is a quantized version of the other (I32/BF16).
2 other repos hold byte-for-byte identical weight files.