Can bert be used for dpo training?

[anyuese]

Hello,I think this work is pretty good. But I have a questionmcan bert be used for dpo training, as large language models are too resource-intensive.Hope for your reply.