tssst/Geranium-105B-v1.0.0
Full fine-tune (fewer layers) vs Sao10K/L3.3-70B-Euryale-v2.3. Sao10K/L3.3-70B-Euryale-v2.3 matches part of tssst/Geranium-105B-v1.0.0 (723 of its 1083 tensors; the rest of tssst/Geranium-105B-v1.0.0 has no counterpart). On the shared part: Fine-tune: 99% of the weights changed, across 80 of 80 layers.
Tensors changed: Embeddings 0/1, Norms 81/161, MLP 240/240, Attention 320/320, lm_head 1/1
1 derivatives checked
- mradermacher/Geranium-105B-v1.0.0-i1-GGUF: Quantization