kubedirector icon indicating copy to clipboard operation
kubedirector copied to clipboard

Published 20 hours ago • verified publisher icon bluek8s

Spark application needs documentation on adding jars

Open snowch opened this issue 3 years ago • 0 comments

The docs page needs instructions for adding jars.

The method I used was:

  • On the livy, master and worker nodes
    • kubectl exec --it NODE -- bash
    • run spark_shell with --packages parameter
    • copy libs from /root/.ivy2/jars to SPARK_HOME/jars
    • restart spark or livy service

snowch avatar Sep 24 '21 21:09 snowch