trl-lib/Qwen2-0.5B-ORPO
Full fine-tune vs Qwen/Qwen2-0.5B-Instruct. Fine-tune: 100% of the weights changed, across 24 of 24 layers.
Tensors changed: Embeddings 1/1, Norms 17/49, MLP 72/72, Attention 168/168
2 derivatives checked
- mradermacher/Qwen2-0.5B-ORPO-i1-GGUF: Quantization
- mradermacher/Qwen2-0.5B-ORPO-GGUF: Same weights, converted