Menlo/Jan-nano-128k

Full fine-tune vs Menlo/Jan-nano. Fine-tune: 90% of the weights changed, across 36 of 36 layers.

Tensors changed: Embeddings 0/1, Norms 105/145, MLP 108/108, Attention 144/144

9 derivatives checked

1 other repos hold byte-for-byte identical weight files.

On the Hub · Downloads on Model Pulse