solidrust/Mistral-7B-Instruct-v0.3-AWQ
Quantization vs mistralai/Mistral-7B-Instruct-v0.3. solidrust/Mistral-7B-Instruct-v0.3-AWQ is a quantized version of the other (I32/F16).
2 other repos hold byte-for-byte identical weight files.
Quantization vs mistralai/Mistral-7B-Instruct-v0.3. solidrust/Mistral-7B-Instruct-v0.3-AWQ is a quantized version of the other (I32/F16).
2 other repos hold byte-for-byte identical weight files.