Holden Karau

Rocking, I've finally got a bit of time for next week, I'll pick this up :)

+1 thats legit We're on PyPi but we could also have folks install from the git url to remind themselves how pre-alpha it is. Thoughts?

So currently we require a user specifies some packages in their env, but some users might be purely dynamic (at least initially) so we should allow building an empty env...

I’d say yes. It’s more no pip packages (we internally depend on som anaconda functionality to bootstrap the installs).

+1 :)

They get triggered by code, if it's a pip req we can just add those more easily.

So the test now distributes Arrow, but this is still important to do in the example. It might be more powerful to do after Spark 2.3 ships so we can...

Note: please don't do this without talking to me first. There are some weird issues around this to keep in mind (that hopefully will just go away with time).

I think that's a really good question, I'd ideally like to think of it in a way which encourages folks to list their dependencies at the start so we can...

Interesting open question: can we dynamically add packages to pex? I'm going to cc @monokrome who told me about pex in the first place :)