TheBloke/Mistral-7B-Instruct-v0.1-GPTQ
Quantization vs mistralai/Mistral-7B-Instruct-v0.1. TheBloke/Mistral-7B-Instruct-v0.1-GPTQ is a quantized version of the other (I32/F16).
2 other repos hold byte-for-byte identical weight files.
Quantization vs mistralai/Mistral-7B-Instruct-v0.1. TheBloke/Mistral-7B-Instruct-v0.1-GPTQ is a quantized version of the other (I32/F16).
2 other repos hold byte-for-byte identical weight files.