princeton-nlp/gemma-2-9b-it-DPO

Full fine-tune vs google/gemma-2-9b-it. Fine-tune: 100% of the weights changed, across 42 of 42 layers.

Tensors changed: Embeddings 1/1, Norms 105/169, MLP 126/126, Attention 168/168

2 derivatives checked

• mradermacher/gemma-2-9b-it-DPO-GGUF: Same weights, converted
• tensorblock/gemma-2-9b-it-DPO-GGUF: Quantization

On the Hub · Downloads on Model Pulse