Update on multilingual

[kerighan]

Is there any update on the multilingual tokenizers? The project seems to be on pause.

[nampdn]

You can get the binary/compile from source to train your own, I think the scope of the project is pretty good for production.

[asifshaikat]

hi @nampdn would please guide me how can i do that for bangla language , I am technical but newbie in core NLP domain. Help will be much appreciated