TozAI/Toz-1
Full fine-tune vs TozAI/Toz-1-Base. Fine-tune: 100% of the weights changed, across 18 of 18 layers.
Tensors changed: Embeddings 1/1, Norms 73/73, MLP 54/54, Attention 72/72
Full fine-tune vs TozAI/Toz-1-Base. Fine-tune: 100% of the weights changed, across 18 of 18 layers.
Tensors changed: Embeddings 1/1, Norms 73/73, MLP 54/54, Attention 72/72