mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit
Quantization vs nvidia/Llama-3.1-Nemotron-70B-Instruct-HF. mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit is a quantized version of the other (U32/F16).
Quantization vs nvidia/Llama-3.1-Nemotron-70B-Instruct-HF. mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit is a quantized version of the other (U32/F16).