iqbalamo93/Phi-4-mini-instruct-GPTQ-8bit

Quantization vs microsoft/Phi-4-mini-instruct. iqbalamo93/Phi-4-mini-instruct-GPTQ-8bit is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse