TheBloke/LlamaGuard-7B-AWQ

Quantization vs llamas-community/LlamaGuard-7b. TheBloke/LlamaGuard-7B-AWQ is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse