Pinkstack/Luau-coder-v2-3B-base-32k
Full fine-tune (fewer layers) vs allenai/OLMo-2-0425-1B. allenai/OLMo-2-0425-1B matches part of Pinkstack/Luau-coder-v2-3B-base-32k (179 of its 399 tensors; the rest of Pinkstack/Luau-coder-v2-3B-base-32k has no counterpart). On the shared part: Fine-tune: 100% of the weights changed, across 16 of 16 layers.
Tensors changed: Embeddings 1/1, MLP 48/48, Norms 56/65, Attention 64/64, lm_head 1/1
2 derivatives checked
- mradermacher/Luau-coder-v2-3B-base-32k-i1-GGUF: Quantization
- mradermacher/Luau-coder-v2-3B-base-32k-GGUF: Same weights, converted