unsloth/llava-v1.6-mistral-7b-hf-bnb-4bit

Quantization vs llava-hf/llava-v1.6-mistral-7b-hf. unsloth/llava-v1.6-mistral-7b-hf-bnb-4bit is a quantized version of the other (U8/BF16).

On the Hub · Downloads on Model Pulse