letechlead/Ornith-1.5-9B-INT4-W4A16-AutoRound

Quantization vs ornith-ai/Ornith-1.5-9B. letechlead/Ornith-1.5-9B-INT4-W4A16-AutoRound is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse