[Feature Request]: Support ignoreUnknownValues in Pub/Sub to BigQuery templates

[zhoufek]

Related Template(s)

Pub/Sub * to BigQuery

What feature(s) are you requesting?

Support the ignoreUnknownValues option in the Pub/Sub -> BigQuery templates. Affected templates:

• Pub/Sub Topic to BigQuery
• Pub/Sub Subscription to BigQuery
• Pub/Sub Avro to BigQuery
• Pub/Sub Proto to BigQuery
• Pub/Sub CDC to BigQuery

Pub/Sub (Topic|Subscription) to BigQuery is harder to support, since they're Classic, and BigQueryIO doesn't support ValueProvider for this option. Options in order of preference:

1. Work to migrate those templates to Flex.
2. Add the option to Beam.
3. Copy BigQueryIO over and add the option.