Stormtrooperaim/Shadowforge-3x7B-MoE
MoE built from dense models vs DarkArtsForge/Avnas-7B-v1.1. Stormtrooperaim/Shadowforge-3x7B-MoE is a mixture of 3 experts assembled from dense models (mergekit-moe style): expert 1 is an exact copy of DarkArtsForge/Avnas-7B-v1.1's MLP; the other experts come from other models. Shared tensors (attention, norms, embeddings): 0 of 193 identical.
1 derivatives checked
- mradermacher/Shadowforge-3x7B-MoE-i1-GGUF: Quantization