syntropy-ai/Soren-1-Small
Partial fine-tune (fewer layers) vs Qwen/Qwen3.5-2B. syntropy-ai/Soren-1-Small matches part of Qwen/Qwen3.5-2B (320 of its 632 tensors; the rest of Qwen/Qwen3.5-2B has no counterpart). On the shared part: Partial change: 53% of the weights changed (attention, mlp, norms), in 24 of 24 layers.
Tensors changed: Attention 24/168, Norms 18/79, Embeddings 0/1, MLP 72/72
1 derivatives checked
- VTXAI/Helvete-nano: LoRA-style