QuantFactory/Qwen1.5-MoE-A2.7B-Wikihow-GGUF
Full fine-tune vs Qwen/Qwen1.5-MoE-A2.7B. QuantFactory/Qwen1.5-MoE-A2.7B-Wikihow-GGUF is a GGUF (Q8_0) of different weights. Fine-tune: 100% of the weights changed, across 24 of 24 layers.
Tensors changed: Embeddings 1/1, Norms 0/49, MLP 96/96, Attention 96/168, lm_head 1/1