OpenMed/OpenMed-PII-Italian-FastClinical-Small-82M-v1
Full fine-tune vs distilbert/distilroberta-base. Fine-tune: 100% of the weights changed, across 6 of 6 layers.
Tensors changed: Embeddings 5/5, Norms 24/24, Attention 48/48, other 24/24
Full fine-tune vs distilbert/distilroberta-base. Fine-tune: 100% of the weights changed, across 6 of 6 layers.
Tensors changed: Embeddings 5/5, Norms 24/24, Attention 48/48, other 24/24