add kto

[enji-zhou]

What does this PR do?

add kto trainer https://arxiv.org/abs/2402.01306

Before submitting

• [x] Did you read the contributor guideline?

[hiyouga]

Hello, could you please handle the package conflicts? Just rename llmtuenr -> llamafactory

[enji-zhou]

Hello, could you please handle the package conflicts? Just rename llmtuenr -> llamafactory

done

[hiyouga]

hmm it seems conflicts still exist, it should be better to open a new PR with the same files

[enji-zhou]

hmm it seems conflicts still exist, it should be better to open a new PR with the same files

好滴 我重新提交一下

[enji-zhou]

hmm it seems conflicts still exist, it should be better to open a new PR with the same files

new mr:https://github.com/hiyouga/LLaMA-Factory/pull/3785

[hiyouga]

Thanks!

[hiyouga]

Duplicate of https://github.com/hiyouga/LLaMA-Factory/pull/3785