Jongbin-kr/llama-3.1-8b-instruct-4x1-moe-sni-switch-top1-router-ffn-lora-aux-anneal-5ep
Adapter vs Jongbin-kr/llama-3.1-8b-instruct-4x1-moe-switch-top1. Jongbin-kr/llama-3.1-8b-instruct-4x1-moe-sni-switch-top1-router-ffn-lora-aux-anneal-5ep is a LoRA adapter, not full weights: rank 16, on down_proj, gate_proj, up_proj in 32 layers (384 adapted matrices). It modifies Jongbin-kr/llama-3.1-8b-instruct-4x1-moe-switch-top1 at load time.