professional-services icon indicating copy to clipboard operation
professional-services copied to clipboard

Add Dataflow Example on streaming analytic to handle schema changes

Open ihaffa-google opened this issue 3 years ago • 1 comments

Using schema enforcement and DLT (Dead Letter Table) approach to handle schema changes when reading and inserting data to BQ. Code include example and unit tests

ihaffa-google avatar Sep 13 '22 14:09 ihaffa-google

The build is failing with this error:

Some files need to be formatted in ./examples/dataflow-streaming-schema-handler - FAIL
./examples/dataflow-streaming-schema-handler/src/main/java/com/google/cloud/pso/pipeline/PubsubToBigQueryJSON.java
./examples/dataflow-streaming-schema-handler/src/main/java/com/google/cloud/pso/util/BigQueryConverters.java

iht avatar Sep 13 '22 14:09 iht