examples
examples copied to clipboard
Shortcut for JVM dependencies
Hi, I was looking for quick (no sbt/maven powered) way of fetching JVM artefacts to the spark docker image. Found wget on your blogpost but it has drawbacks as not true dependency tool. I decided to experiment with Spark as the only dependency manager and managed to do it with this command.
RUN jvm_deps=$(cat jvm_requirements.txt | xargs | sed 's/ /,/g') && \
echo :quit | /usr/local/spark/bin/spark-shell --packages ${jvm_deps}