[Bug]: <Kafka to BigQuery template is confusing and there are no mandatory parameters. Clean up is required. See 4 items mentioned in the What happened section>

[allamsudha]

Related Template(s)

Kafka to BigQuery

Template Version

V2

What happened?

Handle @deprecated annotation properly in order to remove duplicates up on the screen. – Bug Make Kafka broadcast servers list as mandatory – Bug GCP Dataflow Kafka to BigQuery template should be able to read the topics list from Cloud Storage OR BigQuery table prepopulated OR from text box input. One of them is mandatory – Bug CREATE_IF_NEEDED should be the default disposition for not only topics tables but also for dead letter tables. – Bug Unify the solution so that it is using reusable components. For example, datastream merging function may most probably applicable to JDBC, pub/sub, kafka, etc., sources. One reusable component may be sufficient – Bug

Relevant log output

No response