mia-llm/pythia-2.8b-AGnews-LoRA-ilhan

Adapter vs EleutherAI/pythia-2.8b. mia-llm/pythia-2.8b-AGnews-LoRA-ilhan is a LoRA adapter, not full weights: rank 64, on dense, dense_4h_to_h, dense_h_to_4h, query_key_value in 32 layers (128 adapted matrices). It modifies EleutherAI/pythia-2.8b at load time.

On the Hub · Downloads on Model Pulse