mrjob
mrjob copied to clipboard
Failure to run mrjob on dataproc
I set GOOGLE_APPLICATION_CREDENTIALS
env variable properly, and am running a simple mrjob with -r dataproc
option. However, it says
google.api_core.exceptions.Unknown: None Stream removed
While calling
self.cluster_client.get_cluster()
I see that the v1beta2
API has been deprecated in favor of v1
. Does the dataproc plugin need a re-write to adopt it? Anything I can do to help?