mgoin/Kimi-K3-pruned75

Partial fine-tune (fewer layers) vs moonshotai/Kimi-K3. mgoin/Kimi-K3-pruned75 matches part of moonshotai/Kimi-K3 (126092 of its 497220 tensors; the rest of moonshotai/Kimi-K3 has no counterpart). On the shared part: Partial change: 1% of the weights changed (mlp), in 84 of 93 layers.

Tensors changed: Attention 0/1162, Norms 0/639, MLP 197/807, lm_head 0/1, Embeddings 0/3, other 0/29

On the Hub · Downloads on Model Pulse