drawais/Granite-3.3-8B-Instruct-AWQ-INT4

Quantization vs ibm-granite/granite-3.3-8b-instruct. drawais/Granite-3.3-8B-Instruct-AWQ-INT4 is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse