SicariusSicariiStuff/Assistant_Pepe_70B_GPTQ_AR_4-bit-128

Quantization vs SicariusSicariiStuff/Assistant_Pepe_70B. SicariusSicariiStuff/Assistant_Pepe_70B_GPTQ_AR_4-bit-128 is a quantized version of the other (I32/BF16).

On the Hub · Downloads on Model Pulse