marian-dev icon indicating copy to clipboard operation
marian-dev copied to clipboard

[Question] BERT usage in Marian models

Open alvations opened this issue 4 years ago • 1 comments

Any documentation/tutorial for using the BERT as pre-trained embeddings to train a model? Anything close to https://github.com/bert-nmt/bert-nmt?

alvations avatar Apr 29 '20 13:04 alvations

Hi! I am also interested in the answer to the question above! Alternatively - any documentation on pre-training with BERT?

tomsbergmanis avatar Oct 20 '21 10:10 tomsbergmanis