OpenLLM-France/Luciole-8B-Audio-1.0

LoRA-style (fewer layers) vs OpenLLM-France/Luciole-8B-Instruct-1.1. OpenLLM-France/Luciole-8B-Instruct-1.1 matches part of OpenLLM-France/Luciole-8B-Audio-1.0 (310 of its 1023 tensors; the rest of OpenLLM-France/Luciole-8B-Audio-1.0 has no counterpart). On the shared part: Looks like a merged LoRA (or a fine-tune with frozen norms): only the weight matrices of down_proj, q_proj, up_proj, v_proj changed, in 28 of 52 layers; norms, biases and embeddings are untouched.

Tensors changed: Embeddings 0/1, other 0/168, Norms 0/77, MLP 48/48, Attention 8/16

On the Hub · Downloads on Model Pulse