ovedrive/Qwen2.5-7B-Instruct-unbias-4bit

Quantization vs Goekdeniz-Guelmez/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2. ovedrive/Qwen2.5-7B-Instruct-unbias-4bit is a quantized version of the other (U8/BF16).

On the Hub · Downloads on Model Pulse