r3lax/Huihui-Ornith-1.5-35B-A3B-abliterated-MTPLX-mixed8-4bit-FP16

Quantization vs huihui-ai/Huihui-Ornith-1.5-35B-A3B-abliterated. r3lax/Huihui-Ornith-1.5-35B-A3B-abliterated-MTPLX-mixed8-4bit-FP16 is a quantized version of the other (U32/F16).

On the Hub · Downloads on Model Pulse