ner_incomplete_annotation icon indicating copy to clipboard operation
ner_incomplete_annotation copied to clipboard

About the training of contextual embedding

Open possible1402 opened this issue 1 year ago • 1 comments

Hi, thanks for sharing the code! I saw that it's possible to use contextual embedding such as elmo. And in your code of main.py, do you train elmo by yourself? I aslo saw that there are three elmo vector files, do you train elmo for each train/dev/test set? If you can provide some reference code for training elmo models, that would give us more details!

possible1402 avatar Sep 01 '22 08:09 possible1402

I did not train ELMo but using existing pretrained ELMo model from different languages. Usually people pretrain them following the code add provided by AllenNLP, let me know if you need more information

allanj avatar Sep 02 '22 01:09 allanj