long-range-arena
long-range-arena copied to clipboard
Question regarding model checkpoint
Hi, thank you so much for releasing code for this solid work!
I noticed the config.restore_checkpoints flag in all config files is set to True. Does this mean this codebase should only run with a pre-trained model? Or we could simply set that flag to False and train our own models from scratch on this benchmark?
Thank you so much for your time and help!