NotoriousH2/kanana-2-30b-a3b-instruct-2601-awq-w4a16

Quantization vs kakaocorp/kanana-2-30b-a3b-instruct-2601. NotoriousH2/kanana-2-30b-a3b-instruct-2601-awq-w4a16 is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse