mrjob
mrjob copied to clipboard
Allow zero core instances on Dataproc
Just noticed, in https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/cluster-properties that you can allow zero core instances by setting the property dataproc:dataproc.allow.zero.workers
to true
.
Currently the assumption that at least 2 workers are required is hard-coded into __init__()
.