examples icon indicating copy to clipboard operation
examples copied to clipboard

Shortcut for JVM dependencies

Open ppiotrow opened this issue 4 years ago • 0 comments

Hi, I was looking for quick (no sbt/maven powered) way of fetching JVM artefacts to the spark docker image. Found wget on your blogpost but it has drawbacks as not true dependency tool. I decided to experiment with Spark as the only dependency manager and managed to do it with this command.

RUN jvm_deps=$(cat jvm_requirements.txt | xargs | sed 's/ /,/g') && \
    echo :quit | /usr/local/spark/bin/spark-shell --packages ${jvm_deps}

ppiotrow avatar Oct 18 '21 15:10 ppiotrow