add kto
What does this PR do?
add kto trainer https://arxiv.org/abs/2402.01306
Before submitting
- [x] Did you read the contributor guideline?
Hello, could you please handle the package conflicts? Just rename llmtuenr -> llamafactory
Hello, could you please handle the package conflicts? Just rename llmtuenr -> llamafactory
done
hmm it seems conflicts still exist, it should be better to open a new PR with the same files
hmm it seems conflicts still exist, it should be better to open a new PR with the same files
好滴 我重新提交一下
hmm it seems conflicts still exist, it should be better to open a new PR with the same files
new mr:https://github.com/hiyouga/LLaMA-Factory/pull/3785
Thanks!
Duplicate of https://github.com/hiyouga/LLaMA-Factory/pull/3785