nm-testing/llava-onevision-qwen2-7b-ov-hf-FP8-dynamic

Quantization vs llava-hf/llava-onevision-qwen2-7b-ov-hf. nm-testing/llava-onevision-qwen2-7b-ov-hf-FP8-dynamic is a quantized version of the other (F8_E4M3/F16).

On the Hub · Downloads on Model Pulse