jsfs11/MixtureofMerges-MoE-2x7bRP-v8
MoE built from dense models vs ChaoticNeutrals/RP_Vision_7B. jsfs11/MixtureofMerges-MoE-2x7bRP-v8 is a mixture of 2 experts assembled from dense models (mergekit-moe style): expert 0 is an exact copy of ChaoticNeutrals/RP_Vision_7B's MLP; the other experts come from other models. Shared tensors (attention, norms, embeddings): 0 of 195 identical.
1 derivatives checked
- mradermacher/MixtureofMerges-MoE-2x7bRP-v8-i1-GGUF: Quantization