solidrust/dolphin-2.9.4-llama3.1-8b-AWQ

Quantization vs dphn/dolphin-2.9.4-llama3.1-8b. solidrust/dolphin-2.9.4-llama3.1-8b-AWQ is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse