rekstar/omega-attention-0.5b

Adapter vs unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit. rekstar/omega-attention-0.5b is a LoRA adapter, not full weights: rank 16, on down_proj, gate_proj, k_proj, o_proj, q_proj, up_proj, v_proj in 24 layers (168 adapted matrices). It modifies unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit at load time.

1 derivatives checked

On the Hub · Downloads on Model Pulse