RedHatAI/Llama-3.2-1B-FP8

Quantization vs meta-llama/Llama-3.2-1B. RedHatAI/Llama-3.2-1B-FP8 is a quantized version of the other (BF16/F8_E4M3).

On the Hub · Downloads on Model Pulse