Sdff-Ltba/LightChatAssistant-2x7B
MoE built from dense models vs Elizezen/Antler-7B. Sdff-Ltba/LightChatAssistant-2x7B is a mixture of 2 experts with the same shape as Elizezen/Antler-7B's MLP, but none of them is a copy of it: they come from other models or were trained further. Shared tensors (attention, norms, embeddings): 0 of 195 identical.
2 derivatives checked
- mradermacher/LightChatAssistant-2x7B-i1-GGUF: Quantization
- mradermacher/LightChatAssistant-2x7B-GGUF: Quantization