perrital

setting number of thread per executor

3

I'm using version com.microsoft.ml.spark:mmlspark_2.11:1.0.0-rc2 on a k8s cluster. Specifically the lightgbm classifier with binary response. I'm setting num executors to 10 and allocating spark.executor.cores=80 and park.task.cpus=80 so that each machine...