erax-ai/Guardian-V0.1-13Oct2024-epoch2.0
Quantization vs unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit. unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit is a quantized version of the other (U8/BF16).
3 derivatives checked
- mradermacher/Guardian-V0.1-13Oct2024-epoch2.0-i1-GGUF: Quantization
- featherless-ai-quants/erax-ai-Guardian-V0.1-13Oct2024-epoch2.0-GGUF: Quantization
- mradermacher/Guardian-V0.1-13Oct2024-epoch2.0-GGUF: Same weights, converted