hail
hail copied to clipboard
hailctl dataproc does not use specified gcloud configuration
hailctl dataproc
can pass through gcloud configurations specified with --configuration
to the gcloud dataproc
commands that it runs. However, that argument is often not respected for other gcloud
commands that hailctl dataproc
may run. For example, hailctl dataproc start --configuration some_config
gets the project ID for requester pays configuration from the default gcloud configuration, not the specified configuration.
https://github.com/hail-is/hail/blob/9706dd493515bce5aa88c623a83f899e8f8b801b/hail/python/hailtop/hailctl/dataproc/start.py#L262-L265
Hail version: 0.2.57-3f3afaa1d7bd
Zulip chat for context https://hail.zulipchat.com/#narrow/stream/128581-Cloud-support/topic/403.20on.20public.20file