spark-bigquery-connector icon indicating copy to clipboard operation
spark-bigquery-connector copied to clipboard

Published 20 hours ago • verified publisher icon GoogleCloudDataproc

allow setting temporaryGcsBucket creds in the DataFrameWriter's option

Open ruiyang2015 opened this issue 3 years ago • 0 comments

it seems we have to set the global "spark.hadoop.google.cloud.auth.service.account.json.keyfile" for the gcs temporary bucket, we would like to be able to pass in the keyfile for the temporary bucket as an option instead of setting a global spark hadoop config.

ruiyang2015 avatar Aug 12 '21 21:08 ruiyang2015