appvoid/arco-lite
Partial fine-tune vs appvoid/arco. Partial change: 15% of the weights changed (attention, lm_head, mlp, norms), in 1 of 15 layers.
Tensors changed: lm_head 1/1, Embeddings 0/1, Norms 3/31, MLP 3/45, Attention 4/60
Partial fine-tune vs appvoid/arco. Partial change: 15% of the weights changed (attention, lm_head, mlp, norms), in 1 of 15 layers.
Tensors changed: lm_head 1/1, Embeddings 0/1, Norms 3/31, MLP 3/45, Attention 4/60