mrjob icon indicating copy to clipboard operation
mrjob copied to clipboard

Failure to run mrjob on dataproc

Open BradHolmes opened this issue 2 years ago • 0 comments

I set GOOGLE_APPLICATION_CREDENTIALS env variable properly, and am running a simple mrjob with -r dataproc option. However, it says

google.api_core.exceptions.Unknown: None Stream removed

While calling

self.cluster_client.get_cluster()

I see that the v1beta2 API has been deprecated in favor of v1. Does the dataproc plugin need a re-write to adopt it? Anything I can do to help?

BradHolmes avatar May 04 '22 18:05 BradHolmes