ehristoforu/llama3-12b-instruct
Full fine-tune (fewer layers) vs OpenBuddy/openbuddy-llama3-8b-v21.1-8k. OpenBuddy/openbuddy-llama3-8b-v21.1-8k matches part of ehristoforu/llama3-12b-instruct (291 of its 435 tensors; the rest of ehristoforu/llama3-12b-instruct has no counterpart). On the shared part: Fine-tune: 93% of the weights changed, across 32 of 32 layers.
Tensors changed: Embeddings 1/1, Norms 64/65, MLP 96/96, Attention 128/128, lm_head 0/1
1 derivatives checked
- mradermacher/llama3-12b-instruct-GGUF: Quantization