qwp4w3hyb/SFR-Iterative-DPO-LLaMA-3-8B-R-iMat-GGUF

Full fine-tune vs Salesforce/LLaMA-3-8B-SFR-Iterative-DPO-R. qwp4w3hyb/SFR-Iterative-DPO-LLaMA-3-8B-R-iMat-GGUF is a GGUF (BF16) of different weights. Fine-tune: 93% of the weights changed, across 32 of 32 layers.

Tensors changed: Embeddings 0/1, Norms 15/65, MLP 96/96, Attention 128/128, lm_head 1/1

On the Hub · Downloads on Model Pulse