SiLLM
SiLLM copied to clipboard
[Feature request] Add ORPO finetuning
Hi @armbues, thank you for this great project.
Please add ORPO finetuning to do SFT and DPO in one step https://arxiv.org/abs/2403.07691
Hi @armbues, thank you for this great project.
Please add ORPO finetuning to do SFT and DPO in one step https://arxiv.org/abs/2403.07691