Beta (DPO)
The DPO parameter controlling how strongly to stay near the reference (SFT) model.
The DPO parameter controlling how strongly to stay near the reference (SFT) model. (M12)
The DPO parameter controlling how strongly to stay near the reference (SFT) model.
The DPO parameter controlling how strongly to stay near the reference (SFT) model. (M12)