mleap
mleap copied to clipboard
Integrate with spark-nlp
spark-nlp
Is a library that was developed by john snow labs to offer common transformers for NLP to Spark. It would be incredibly useful to be able to train these models and then deploy them with MLeap.
https://github.com/JohnSnowLabs/spark-nlp
We still need to outline the work in terms of which transformers and models we need to offer support for and if we will include them in core modules or create separate modules for NLP.
Spacy is also a good candidate for industrial NLP.