unsloth/Phi-3.5-mini-instruct-bnb-4bit

Quantization vs microsoft/Phi-3.5-mini-instruct. unsloth/Phi-3.5-mini-instruct-bnb-4bit is a quantized version of the other (U8/BF16).

1 derivatives checked

• rubuntu/Phi-3.5-mini-instruct-Jopara-V3: Quantization

3 other repos hold byte-for-byte identical weight files.

On the Hub · Downloads on Model Pulse