magpie icon indicating copy to clipboard operation
magpie copied to clipboard

Published 20 hours ago • verified publisher icon LLNL

enable spark.worker.cleanup by default

Open chu11 opened this issue 5 years ago • 1 comments

i.e.

export SPARK_WORKER_OPTS="-Dspark.worker.cleanup.enabled=yes"

chu11 avatar Aug 07 '18 21:08 chu11

pro: cleanup stuff if user has long running job con: user may want to gather/store logs after job run

should be an option?

chu11 avatar Sep 04 '18 21:09 chu11