nm-testing/Phi-3.5-vision-instruct-FP8-dynamic

Quantization vs microsoft/Phi-3.5-vision-instruct. nm-testing/Phi-3.5-vision-instruct-FP8-dynamic is a quantized version of the other (F8_E4M3/BF16).

On the Hub · Downloads on Model Pulse