malvavisc0/OxCoder-9B-gptq-int4

Quantization vs OrionLLM/OxCoder-9B. malvavisc0/OxCoder-9B-gptq-int4 is a quantized version of the other (BF16/I32).

On the Hub · Downloads on Model Pulse