Joseph717171/Hermes-2-Pro-Mistral-10.7B
Full fine-tune (fewer layers) vs mistralai/Mistral-7B-v0.1. mistralai/Mistral-7B-v0.1 matches part of Joseph717171/Hermes-2-Pro-Mistral-10.7B (289 of its 435 tensors; the rest of Joseph717171/Hermes-2-Pro-Mistral-10.7B has no counterpart). On the shared part: Fine-tune: 100% of the weights changed, across 32 of 32 layers.
Tensors changed: Norms 28/65, MLP 96/96, Attention 128/128
1 derivatives checked
- mradermacher/Hermes-2-Pro-Mistral-10.7B-GGUF: Quantization