gluon-nlp icon indicating copy to clipboard operation
gluon-nlp copied to clipboard

Extend bert/embedding.py with other pre-trained models

Open eric-haibin-lin opened this issue 5 years ago • 2 comments

We shall extend bert/embedding.py with other pre-trained models like XLNet, RoBERTa, R-XLM, ALBERT, etc. This is a good starting script where people try to leverage pre-trained model embeddings for their models for various use cases. @leezu this is somewhat aligned with the efforts for refactoring data preprocessing. I am also ok if we make copy-pastable embedding.py for other pre-trained models.

eric-haibin-lin avatar Dec 13 '19 06:12 eric-haibin-lin

Hey, I want to give this a try! I cannot find the file "bert/embedding.py"!

karish-grover avatar Aug 29 '21 13:08 karish-grover

@karish-grover the repository seems to have changed since then and a lot of other models seem to be in place now..

AetherPrior avatar Aug 29 '21 13:08 AetherPrior