mit-han-lab/svdq-int4-shuttle-jaguar

Adapter vs shuttleai/shuttle-jaguar. mit-han-lab/svdq-int4-shuttle-jaguar is a LoRA adapter, not full weights: rank 3072-12288, on mlp_context_fc1, mlp_context_fc2, mlp_fc1, mlp_fc2, out_proj, out_proj_context, qkv_proj, qkv_proj_context (304 adapted matrices). It modifies shuttleai/shuttle-jaguar at load time.

On the Hub · Downloads on Model Pulse