eaglew

I suffer the same question, from the Spark WebUI,there are two workers alive, if i set as below, only one worker is used. export SPARK_WORKER_INSTANCES=1 export CORES_PER_WORKER=1 export TOTAL_CORES=$((${CORES_PER_WORKER}*${SPARK_WORKER_INSTANCES})) ....