Gabe Church issues

Repositories
Issues
Comments

Results 3 issues of


                                            Gabe Church

Yarn Support On HDP 2.6.0.3-8 with Spark 2.xx

It seems that using spark-notebook on a newer versions of hortonworks hadoop and spark will cause an error to be thrown when attempting to use with the yarn-manager in cluster...

Add Pex support for ray-on-spark, this allows users to 'ship' any ver…

…sion of ray to any spark cluster using the only universally compatible mechanism, pex ## Why are these changes needed? PEX is a very powerful python dependency distribution tool. It...

triage

@external-author-action-required

core

Modify Spark on Ray to support Pex and other virtualenvs + direct scr…

…ipts launch in databricks runtime Modify Spark on Ray to support Pex and other virtualenvs + direct scripts launch in databricks runtime @WeichenXu123 @jjyao @anyscalesam ## Why are these changes...