mlx-community/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-8bit

Quantization vs nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16. mlx-community/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-8bit is a quantized version of the other (U32/BF16).

On the Hub · Downloads on Model Pulse