neulab/CulturalPangea-7B

Partial fine-tune vs neulab/Pangea-7B. Partial change: 89% of the weights changed (attention, lm_head, mlp, norms, other), in 28 of 28 layers.

Tensors changed: Embeddings 0/4, other 5/5, Norms 57/157, MLP 84/180, Attention 196/388, lm_head 1/1

On the Hub · Downloads on Model Pulse