mergekit-community/mergekit-slerp-fecxcxs
Full fine-tune (fewer layers) vs budecosystem/code-millenials-34b. mergekit-community/mergekit-slerp-fecxcxs matches part of budecosystem/code-millenials-34b (289 of its 435 tensors; the rest of budecosystem/code-millenials-34b has no counterpart). On the shared part: Fine-tune: 97% of the weights changed, across 32 of 32 layers.
Tensors changed: Norms 65/65, MLP 93/96, Attention 124/128
1 derivatives checked
- MaziyarPanahi/mergekit-slerp-fecxcxs-GGUF: Quantization