sergeyzh/rubert-tiny-turbo
Full fine-tune vs cointegrated/rubert-tiny2. Fine-tune: 98% of the weights changed, across 3 of 3 layers.
Tensors changed: Embeddings 4/5, Norms 12/12, Attention 24/24, other 14/14
2 derivatives checked
- sergeyzh/rubert-tiny-sts-v2: Full fine-tune
- sergeyzh/rubert-tiny-retriever: Full fine-tune