scio
scio copied to clipboard
Make the temporary table prefix and target dataset configurable in the MockBigQuery class
Actually temporary table prefix and staging dataset are defined in TableOps. This prevents us from specifying them when calling the mockTable method in the MockBigQuery. https://github.com/spotify/scio/blob/main/scio-google-cloud-platform/src/main/scala/com/spotify/scio/bigquery/client/TableOps.scala#L48 We need this because we don't necessarily have the authorizations to create datasets on the fly.
https://github.com/spotify/scio/pull/4474
@azaroui can you expand a little more on why you need temp table prefix to be configurable?
@clairemcginty I want to have table prefix configurable to be able to give meaningful names for each test case