MarsupialAI/Aqueducts-18B
Full fine-tune (fewer layers) vs upstage/SOLAR-10.7B-v1.0. upstage/SOLAR-10.7B-v1.0 matches part of MarsupialAI/Aqueducts-18B (435 of its 723 tensors; the rest of MarsupialAI/Aqueducts-18B has no counterpart). On the shared part: Fine-tune: 100% of the weights changed, across 48 of 48 layers.
Tensors changed: Embeddings 1/1, Norms 97/97, MLP 144/144, Attention 192/192, lm_head 1/1
1 derivatives checked
- mradermacher/Aqueducts-18B-i1-GGUF: Quantization