prism-ml/Bonsai-8B-AWQ-4-bit

Quantization vs prism-ml/Bonsai-8B-unpacked. prism-ml/Bonsai-8B-AWQ-4-bit is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse