BenevolenceMessiah/Yi-Coder-9B-Chat-Instruct-TIES-MoE-v1.0
MoE built from dense models vs BenevolenceMessiah/Yi-Coder-9B-Chat-Instruct-TIES. BenevolenceMessiah/Yi-Coder-9B-Chat-Instruct-TIES-MoE-v1.0 is a mixture of 4 experts assembled from dense models (mergekit-moe style): experts 2, 3 are an exact copy of BenevolenceMessiah/Yi-Coder-9B-Chat-Instruct-TIES's MLP; the other experts come from other models. Shared tensors (attention, norms, embeddings): 291 of 291 identical.