quant-mind/Nex-N2.5-mini-W4A16-AutoRound

Quantization vs nex-agi/Nex-N2.5-mini. quant-mind/Nex-N2.5-mini-W4A16-AutoRound is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse