scio icon indicating copy to clipboard operation
scio copied to clipboard

Make the temporary table prefix and target dataset configurable in the MockBigQuery class

Open azaroui opened this issue 2 years ago • 2 comments

Actually temporary table prefix and staging dataset are defined in TableOps. This prevents us from specifying them when calling the mockTable method in the MockBigQuery. https://github.com/spotify/scio/blob/main/scio-google-cloud-platform/src/main/scala/com/spotify/scio/bigquery/client/TableOps.scala#L48 We need this because we don't necessarily have the authorizations to create datasets on the fly.

azaroui avatar May 12 '22 09:05 azaroui

https://github.com/spotify/scio/pull/4474

farzad-sedghi avatar Jul 26 '22 22:07 farzad-sedghi

@azaroui can you expand a little more on why you need temp table prefix to be configurable?

clairemcginty avatar Aug 01 '22 17:08 clairemcginty

@clairemcginty I want to have table prefix configurable to be able to give meaningful names for each test case

azaroui avatar Aug 11 '22 07:08 azaroui