marian-dev
marian-dev copied to clipboard
[Question] BERT usage in Marian models
Any documentation/tutorial for using the BERT as pre-trained embeddings to train a model? Anything close to https://github.com/bert-nmt/bert-nmt?
Hi! I am also interested in the answer to the question above! Alternatively - any documentation on pre-training with BERT?