ibm-ai-platform/micro-g3.3-8b-instruct-1b-FP8

Quantization vs ibm-ai-platform/micro-g3.3-8b-instruct-1b. ibm-ai-platform/micro-g3.3-8b-instruct-1b-FP8 is a quantized version of the other (BF16/F8_E4M3).

On the Hub · Downloads on Model Pulse