Python Interpreter for parsing html/xml in zepplin

[mkscala]

I wanted to use the Python APIs like BeautifulSoup, how can we use external python api's along with pyspark http://omz-software.com/pythonista/docs/ios/beautifulsoup_guide.html http://apache-spark-user-list.1001560.n3.nabble.com/How-to-consider-HTML-files-in-Spark-td22017.html https://pypi.python.org/pypi/beautifulsoup4

[dylanmei]

%sh pip install beautifulsoup4

I don't know any details about actually using it effectively with Spark. Spark has a very active mailing list and freenode #apache-spark IRC channel which I'm sure will yield better tips.

[mkscala]

I get the below error Process exited with an error: 127 (Exit value: 127)

[mkscala]

how to add the basic python interpreter ? have you tried ? within this docker-zepplin?

[dylanmei]

There is only the pyspark interpreter. Perhaps you'd get more mileage with this: https://github.com/jupyter/docker-stacks