SimPO icon indicating copy to clipboard operation
SimPO copied to clipboard

Question about the optimizer

Open pspdada opened this issue 7 months ago • 0 comments

Hello! I have some questions about the optimizer used in your training. The paper mentions, "We use an Adam optimizer [47] for all the experiments." However, I noticed that the code uses the AdamW optimizer instead, as stated in the training configuration .yaml file with the line optim: adamw_torch. Could you please clarify this?

pspdada avatar May 24 '25 11:05 pspdada