aselea/Kev-4B-MLX-Serve-8bit

Adapter vs jaredpalmer/kev-4b. jaredpalmer/kev-4b is a LoRA adapter, not full weights: rank 16, on down_proj, gate_proj, in_proj_a, in_proj_b, in_proj_qkv, in_proj_z, k_proj, o_proj… in 32 layers (248 adapted matrices). It modifies aselea/Kev-4B-MLX-Serve-8bit at load time.

On the Hub · Downloads on Model Pulse