long-range-arena icon indicating copy to clipboard operation
long-range-arena copied to clipboard

Question regarding model checkpoint

Open LeoXinhaoLee opened this issue 2 years ago • 0 comments

Hi, thank you so much for releasing code for this solid work!

I noticed the config.restore_checkpoints flag in all config files is set to True. Does this mean this codebase should only run with a pre-trained model? Or we could simply set that flag to False and train our own models from scratch on this benchmark?

Thank you so much for your time and help!

LeoXinhaoLee avatar Jul 04 '23 23:07 LeoXinhaoLee