mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-bf16

Same weights, repacked vs nvidia/Llama-3.1-Nemotron-70B-Instruct-HF. Same weights in different files (re-saved, re-sharded or new metadata).

Tensors changed: Embeddings 0/1, Norms 0/161, MLP 0/240, Attention 0/320, lm_head 0/1

1 derivatives checked

• featherless-ai-quants/mlx-community-Llama-3.1-Nemotron-70B-Instruct-HF-bf16-GGUF: Quantization

On the Hub · Downloads on Model Pulse