kalomaze/Qwen3-16B-A3B

LoRA-style (fewer layers) vs Qwen/Qwen3-30B-A3B. kalomaze/Qwen3-16B-A3B matches part of Qwen/Qwen3-30B-A3B (9603 of its 18867 tensors; the rest of Qwen/Qwen3-30B-A3B has no counterpart). On the shared part: Looks like a merged LoRA (or a fine-tune with frozen norms): only the weight matrices of down_proj, gate_proj, up_proj changed, in 48 of 48 layers; norms, biases and embeddings are untouched.

Tensors changed: Embeddings 0/1, Norms 0/193, MLP 1289/1310, Attention 0/192, lm_head 0/1

7 derivatives checked

1 other repos hold byte-for-byte identical weight files.

On the Hub · Downloads on Model Pulse