RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16

Quantization vs HuggingFaceTB/SmolLM-1.7B-Instruct. RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16 is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse