TheBloke/CodeLlama-13B-Instruct-AWQ

Quantization vs codellama/CodeLlama-13b-Instruct-hf. TheBloke/CodeLlama-13B-Instruct-AWQ is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse