tfiasco
tfiasco
I reconsidered this problem, and I'm not sure if the failed status is the result of failure in deleting temp directory or not. This is the output of console: ```...
I used the command `sparkclr-submit.sh --master yarn --deploy-mode cluster --num-executors 4 --executor-cores 2 --executor-memory 1G --conf spark.speculation=true --driver-memory 1G --exe SparkClrPi.exe /usr/lib/sparkclr/examples/Batch/pi/` The status is still FAILED, and stderr is...
Yes, I tried `spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster ./examples/jars/spark-examples_2.11-2.0.2.jar 10` which returned a succeeded final status.
The last lines in stderr of `Scala` example are: ``` 17/03/21 16:01:01 INFO scheduler.DAGScheduler: ResultStage 0 (reduce at SparkPi.scala:38) finished in 3.468 s 17/03/21 16:01:01 INFO cluster.YarnClusterScheduler: Removed TaskSet 0.0,...
The SparkClrPi example returns a SUCCEEDED final status in yarn client mode, but in yarn cluster mode it is FAILED.