hoborific/Midnight-Miqu-70B-v1.5-W4A16-AutoRound

Quantization vs sophosympatheia/Midnight-Miqu-70B-v1.5. hoborific/Midnight-Miqu-70B-v1.5-W4A16-AutoRound is a quantized version of the other (I32/F16).

On the Hub · Downloads on Model Pulse