bert-stable-fine-tuning icon indicating copy to clipboard operation
bert-stable-fine-tuning copied to clipboard

Published 20 hours ago • verified publisher icon uds-lsv

Adam Epsilon Choice

Open jacky18008 opened this issue 3 years ago • 0 comments

Hi authors,

Thank you for your excellent work! I just found a difference between Adam Epsilon that the paper state as 1e-6, while the example scripts on this repo are set to default as 1e-8, and all the instructions in the examples dir use the default value as 1e-8.

Do you have any instruction/recommendations for the value?

Thank you so much!

Screen Shot 2021-12-17 at 12 07 15 PM Screen Shot 2021-12-17 at 12 07 09 PM

jacky18008 avatar Dec 17 '21 04:12 jacky18008