Alessandro Giagnorio

DPO models generate multiple / corrupted responses

57

Hi, I am running some tests with DPOTrainer to see how it works but I have encountered some problems during the inference phase of the generated model. In details, this...

Hello, do you know up to what date ( approximately ) the data for model training was collected?

Information about the position of the modified lines / tokens

5

Hi, thank you very much for implementing this library. I would like to have more information about its use for the following scenario: given two code snippets, I would like...