FangHainannn
Results
1
comments of
FangHainannn
Maybe you should check if your ref_model is a static reference copy of model. There is the following code snippet in DPOTrainer __init__(): ``` if ref_model: self.ref_model = ref_model elif...