cyankiwi/Inkling-Small-AWQ-INT4

Quantization vs thinkingmachines/Inkling-Small. cyankiwi/Inkling-Small-AWQ-INT4 is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse