theminji/Llama3-Toxic-8B-Float16
Quantization vs unsloth/llama-3-8b-bnb-4bit. unsloth/llama-3-8b-bnb-4bit is a quantized version of the other (U8/BF16).
3 derivatives checked
- mradermacher/ToxicLlama3-8B-Float16-GGUF: Same weights, converted
- mradermacher/Llama3-Toxic-8B-Float16-i1-GGUF: Quantization
- mradermacher/Llama3-Toxic-8B-Float16-GGUF: Same weights, converted