Marius van Niekerk

So this is probably due to an issue with pyspark 2.1.0 under python 3.6. Try running it with python 3.5

So for 1 the idea is to use the %%init_spark magic

A reasonable amount of the spylon scala utilities aren't that needed anymore due to improvements in py4j as well.

So spylon can't really do scala in Ipython.

What is mp.sparkSession?

Thanks

Might be of interest to take a look at https://github.com/Tinche/aiofiles

@hit9 Is there something i can do to help speed this along? We are currently blocked by this issue.

So thrift_sasl works with thriftpy, and is used by impyla to do kerberized auth.

@wesm, @xhochy what would be the approrpriate changes to make in Arrow, I took at look at the datetime parts of arrow-cpp but it wasn't clear to me what we...