TensorVizion/distillgpt2-turbo
Full fine-tune vs distilbert/distilgpt2. Fine-tune: 100% of the weights changed, across 6 of 6 layers.
Tensors changed: Attention 24/24, Norms 26/26, MLP 24/24, Embeddings 2/2
Full fine-tune vs distilbert/distilgpt2. Fine-tune: 100% of the weights changed, across 6 of 6 layers.
Tensors changed: Attention 24/24, Norms 26/26, MLP 24/24, Embeddings 2/2