cyankiwi/Llama-3.1-8B-Instruct-AWQ-INT4

Quantization vs meta-llama/Llama-3.1-8B-Instruct. cyankiwi/Llama-3.1-8B-Instruct-AWQ-INT4 is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse