amd/Instella-MoE-16B-A3B-SFT-w8a8-llmcompressor

Quantization vs amd/Instella-MoE-16B-A3B-SFT. amd/Instella-MoE-16B-A3B-SFT-w8a8-llmcompressor is a quantized version of the other (BF16/I8).

On the Hub · Downloads on Model Pulse