Example for training a BERT model from scratch using new data without using pre-trained weights

[wenbostar]

Hi,

The library looks great. I'm trying to use BERT for biological sequence tasks so I cannot use the pre-trained models with language data. Could you provide an example to show how to train a BERT model from scratch using new data without using any pre-trained weights?

Thank you in advance.

Bo

[antopemo]

I would love to see this too, I need to pretrain for a different task and an example would be great!