RedHatAI/Kimi-K3-NVFP4
Partial fine-tune vs moonshotai/Kimi-K3. Partial change: 1% of the weights changed (mlp), in 91 of 93 layers.
Tensors changed: Attention 0/1162, Norms 0/639, MLP 197/807, other 0/213, lm_head 0/1, Embeddings 0/3
Partial fine-tune vs moonshotai/Kimi-K3. Partial change: 1% of the weights changed (mlp), in 91 of 93 layers.
Tensors changed: Attention 0/1162, Norms 0/639, MLP 197/807, other 0/213, lm_head 0/1, Embeddings 0/3