fblgit/UNA-SOLAR-10.7B-Instruct-v1.0
Full fine-tune vs upstage/SOLAR-10.7B-Instruct-v1.0. Fine-tune: 93% of the weights changed, across 48 of 48 layers.
Tensors changed: Embeddings 0/1, Norms 0/97, MLP 136/144, Attention 182/192, lm_head 1/1
Full fine-tune vs upstage/SOLAR-10.7B-Instruct-v1.0. Fine-tune: 93% of the weights changed, across 48 of 48 layers.
Tensors changed: Embeddings 0/1, Norms 0/97, MLP 136/144, Attention 182/192, lm_head 1/1