jakeatx/slimder-qwen38-reap384-depth40-mb4-5
Partial fine-tune (fewer layers) vs jakeatx/slimder-qwen38-reap384-s0. jakeatx/slimder-qwen38-reap384-depth40-mb4-5 matches part of jakeatx/slimder-qwen38-reap384-s0 (1102 of its 1627 tensors; the rest of jakeatx/slimder-qwen38-reap384-s0 has no counterpart). On the shared part: Partial change: 36% of the weights changed (attention, mlp, norms), in 24 of 40 layers.
Tensors changed: Norms 90/154, other 0/5, Attention 246/410, MLP 240/400, Embeddings 0/132, lm_head 0/1
3 derivatives checked
- jakeatx/slimder-qwen38-reap384-depth40-mb4-5-GGUF: Not comparable yet
- jakeatx/slimder-qwen38-reap384-depth32-mb2-3-4-5: Partial fine-tune
- jakeatx/slimder-qwen38-reap384-depth36-mb2-4-5: Partial fine-tune