joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4

Quantization vs nvidia/Llama-3.1-Nemotron-70B-Instruct-HF. joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4 is a quantized version of the other (I32/F16).

1 other repos hold byte-for-byte identical weight files.

On the Hub · Downloads on Model Pulse