akthegr8/excelpdf
MoE built from dense models vs OpenPipe/mistral-ft-optimized-1218. akthegr8/excelpdf is a mixture of 2 experts with the same shape as OpenPipe/mistral-ft-optimized-1218's MLP, but none of them is a copy of it: they come from other models or were trained further. Shared tensors (attention, norms, embeddings): 195 of 195 identical.