ThomasComics/Noro-Hermes-3x7B
MoE built from dense models vs NeverSleep/Noromaid-7B-0.4-DPO. ThomasComics/Noro-Hermes-3x7B is a mixture of 3 experts assembled from dense models (mergekit-moe style): expert 1 is an exact copy of NeverSleep/Noromaid-7B-0.4-DPO's MLP; the other experts come from other models. Shared tensors (attention, norms, embeddings): 0 of 193 identical.
1 derivatives checked
- mradermacher/Noro-Hermes-3x7B-GGUF: Not comparable yet