torchtune icon indicating copy to clipboard operation
torchtune copied to clipboard
verified publisher icon pytorch

Investigate PreferenceDataset truncation

Open RdoubleA opened this issue 1 year ago • 1 comments

Investigate this comment here: "Truncation differs from original DPO repo"

https://github.com/pytorch/torchtune/blob/main/torchtune/datasets/_preference.py#L97

RdoubleA avatar Aug 13 '24 22:08 RdoubleA

@SalmanMohammadi Can this be closed?

joecummings avatar Apr 22 '25 20:04 joecummings