Ttimofeyka/Cydonia-Mini-6.6B

Full fine-tune (fewer layers) vs TheDrummer/Cydonia-22B-v1.2. Ttimofeyka/Cydonia-Mini-6.6B matches part of TheDrummer/Cydonia-22B-v1.2 (147 of its 507 tensors; the rest of TheDrummer/Cydonia-22B-v1.2 has no counterpart). On the shared part: Fine-tune: 94% of the weights changed, across 16 of 16 layers.

Tensors changed: lm_head 0/1, Embeddings 0/1, Norms 32/33, MLP 48/48, Attention 64/64

2 derivatives checked

On the Hub · Downloads on Model Pulse