elmo-bilstm-cnn-crf
elmo-bilstm-cnn-crf copied to clipboard
do this code also suitable for Chinese?
Not really. As far as I know there are no ELMo embeddings for chinese so far. Further, you would need to provide word boundaries in order that the code is runnable. Otherwise it would read the complete sentence as a single token.
@zhaoyueplc check here for a pretrained model for many language https://github.com/HIT-SCIR/ELMoForManyLangs but it is trained with customer setting, further modifier would be need according the issue reported there. I am planning to use the German pretrained model, would be nice if anyone can share that if it works. Thanks. John
It appears that ELMoForManyLangs is sadly not compatible with the original AllenNLP architecture (and hence sadly cannot be used with this framework): https://github.com/HIT-SCIR/ELMoForManyLangs/issues/1
Maybe I find a way how to support their ELMo weights for AllenNLP
Anyone have any success with this? I tried running their model on a conllu file but I am unable to "get" the representations like you would with the AllenNLP version.
If anyone knows the best way to do this please let me know.
https://github.com/HIT-SCIR/ELMoForManyLangs/issues/7