winninghealth/WiNGPT-Babel-2
Full fine-tune vs ModelSpace/GemmaX2-28-2B-Pretrain. Fine-tune: 100% of the weights changed, across 26 of 26 layers.
Tensors changed: Embeddings 1/1, Norms 95/105, MLP 78/78, Attention 104/104
1 derivatives checked
- winninghealth/WiNGPT-Babel-2-GGUF: Quantization