THU-KEG/SIRI-1.5B-low

Partial fine-tune vs deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B. Partial change: 87% of the weights changed (attention, lm_head, mlp, norms), in 28 of 28 layers.

Tensors changed: Embeddings 0/1, Attention 196/196, MLP 84/84, Norms 40/57, lm_head 1/1

2 derivatives checked

• mradermacher/SIRI-1.5B-low-i1-GGUF: Quantization
• mradermacher/SIRI-1.5B-low-GGUF: Same weights, converted

On the Hub · Downloads on Model Pulse