NousResearch/Nous-Hermes-2-Mistral-7B-DPO-GGUF
Full fine-tune vs mistralai/Mistral-7B-v0.1. NousResearch/Nous-Hermes-2-Mistral-7B-DPO-GGUF is a GGUF (Q8_0) of different weights. Fine-tune: 100% of the weights changed, across 32 of 32 layers.
Tensors changed: Norms 17/65, MLP 96/96, Attention 128/128