amd/Phi-4-mini-instruct-w4a16-llmcompressor

Quantization vs microsoft/Phi-4-mini-instruct. amd/Phi-4-mini-instruct-w4a16-llmcompressor is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse