Naphula/Promethean-Dawn-26B-A4B

Partial fine-tune (fewer layers) vs ReadyArt/Dark-Scarlett-v1.0-26B-A4B. Naphula/Promethean-Dawn-26B-A4B matches part of ReadyArt/Dark-Scarlett-v1.0-26B-A4B (662 of its 1013 tensors; the rest of ReadyArt/Dark-Scarlett-v1.0-26B-A4B has no counterpart). On the shared part: Partial change: 9% of the weights changed (attention, embeddings, mlp), in 30 of 30 layers.

Tensors changed: Embeddings 1/4, MLP 90/150, Norms 0/271, other 0/122, Attention 115/115

On the Hub · Downloads on Model Pulse