mphd1/pythia6.9b-pqa
Full fine-tune vs EleutherAI/pythia-6.9b. Fine-tune: 100% of the weights changed, across 32 of 32 layers.
Tensors changed: Embeddings 2/2, Attention 128/128, Norms 130/130, MLP 128/128
Full fine-tune vs EleutherAI/pythia-6.9b. Fine-tune: 100% of the weights changed, across 32 of 32 layers.
Tensors changed: Embeddings 2/2, Attention 128/128, Norms 130/130, MLP 128/128