XReyRobert/Ornith-1.0-35B-GPTQ-Pro-FOEM-4bit-g128-ns256

Quantization vs ornith-ai/Ornith-1.0-35B. XReyRobert/Ornith-1.0-35B-GPTQ-Pro-FOEM-4bit-g128-ns256 is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse