ailexleon/Orion-26B-A4B-v1.1-mlx-8Bit

Quantization vs TheDrummer/Orion-26B-A4B-v1.1. ailexleon/Orion-26B-A4B-v1.1-mlx-8Bit is a quantized version of the other (U32/BF16).

On the Hub · Downloads on Model Pulse