DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

Kafka to BigQuery with SSL

Open matheusjerico opened this issue 4 years ago • 9 comments

How I can use kafka to bigquery template (https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-bigquery or https://github.com/GoogleCloudPlatform/java-docs-samples/tree/master/dataflow/flex-templates/kafka_to_bigquery) with SSL Kafka?

I didn't find any configuration to pass SSL files (truststore/keystore) to template.

How I can make this configuration?

matheusjerico avatar Oct 20 '20 15:10 matheusjerico

We are working on releasing a Kafka template that supports additional security capabilities including SSL and Kerberos. This should be available in this repo later in this quarter.

sabhyankar avatar Oct 20 '20 15:10 sabhyankar

@sabhyankar Thanks!

matheusjerico avatar Oct 20 '20 16:10 matheusjerico

@matheusjerico https://github.com/doitintl/dataflow-kafka-to-bq

orensham avatar Mar 17 '21 18:03 orensham

@sabhyankar any updates on this? Has it been implemented? Found this, but not sure if it covers OPs needs

Ozzyz avatar Jun 24 '22 10:06 Ozzyz

Any update? Just wonder to change default security.protocol=PLAINTEXT to SSL

dodywicahyo avatar Sep 26 '22 23:09 dodywicahyo

@dodywicahyo do you managed to solve an issue somehow?

nosovk avatar May 25 '23 12:05 nosovk