"mapred.bq.temp.gcs.path" error when folder already exists

[lfiaschi]

When the folder corresponding to the parameter mapred.bq.temp.gcs.path already exists an exception is thrown

java.io.IOException: Conflict occurred creating export directory. Path gs://rocket-omds-cluster-tmp/test7 already exists

It could be handy to allow the client code to configure overriding of the temp folder or allow using a folder that already exists.

[Cidan]

bubbling this up; not being able to overwrite the temp dir on gcs really sucks for automation.

[jasonjho]

Any updates on this?