Ebrahim Safavi

DPO alignment doesn't work on Lora models as suggested

1

You claim that "[In practice, we find comparable performance for both full and LoRA fine-tuning, with the latter having the advantage of producing small adapter weights that are fast to...