QuantFactory/gemma-2-9b-it-DPO-GGUF
Full fine-tune vs google/gemma-2-9b-it. QuantFactory/gemma-2-9b-it-DPO-GGUF is a GGUF (Q8_0) of different weights. Fine-tune: 100% of the weights changed, across 42 of 42 layers.
Tensors changed: Embeddings 1/1, Norms 1/169, MLP 126/126, Attention 168/168