jomangbp/seldonium-2x7b-MoE-v0.1
MoE built from dense models vs Locutusque/Hercules-4.0-Mistral-v0.2-7B. jomangbp/seldonium-2x7b-MoE-v0.1 is a mixture of 2 experts assembled from dense models (mergekit-moe style): expert 0 is an exact copy of Locutusque/Hercules-4.0-Mistral-v0.2-7B's MLP; the other experts come from other models. Shared tensors (attention, norms, embeddings): 0 of 193 identical.
1 derivatives checked
- mradermacher/seldonium-2x7b-MoE-v0.1-i1-GGUF: Quantization