MC7ever/spark-darwin-6way
Full fine-tune vs OceanLabs/Ocean-1-4B. Fine-tune: 100% of the weights changed, across 36 of 36 layers.
Tensors changed: Embeddings 1/1, Norms 5/73, MLP 108/108, Attention 108/108
Full fine-tune vs OceanLabs/Ocean-1-4B. Fine-tune: 100% of the weights changed, across 36 of 36 layers.
Tensors changed: Embeddings 1/1, Norms 5/73, MLP 108/108, Attention 108/108