mergekit-community/Topsecret
Full fine-tune (fewer layers) vs NousResearch/Nous-Hermes-2-SOLAR-10.7B. mergekit-community/Topsecret matches part of NousResearch/Nous-Hermes-2-SOLAR-10.7B (181 of its 435 tensors; the rest of NousResearch/Nous-Hermes-2-SOLAR-10.7B has no counterpart). On the shared part: Fine-tune: 95% of the weights changed, across 20 of 20 layers.
Tensors changed: Norms 41/41, MLP 57/60, Attention 76/80
1 derivatives checked
- MaziyarPanahi/Topsecret-GGUF: Quantization