Yunjae_Won

Why does SFT sum the cross-entropy loss within each sequence?

3

Thank you for maintaining such an important repository. I really enjoyed and learned a lot from reading your DPO paper. I have one question regarding the SFT loss implementation in...