Bruno Volpato
Bruno Volpato
After 2.40.0 (this PR https://github.com/apache/beam/pull/17423), there are three to get the failed inserts from a `BigQueryIO` Write, as it was now added a specific tag/PCollection when using the write method...
Hello there, I followed the [flex-template tutorial](https://github.com/GoogleCloudPlatform/DataflowTemplates/blob/main/tutorials/flex-template.md), and it worked well. Thanks for putting it together! There were 2 minor issues while following it: - [x] Integration tests are failing...
Fixes issue https://github.com/apache/beam/issues/22146 (also reported on [StackOverflow](https://stackoverflow.com/questions/73765145/apache-beam-illegalstateexception-value-only-available-at-runtime-after-upgra)). [ValueProvider](https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/options/ValueProvider.html) can be used to pass runtime parameters not available during pipeline creation (which is heavily used by [Dataflow Templates](https://cloud.google.com/dataflow/docs/concepts/dataflow-templates)). In case a...
Will help on bug https://github.com/GoogleCloudPlatform/DataflowTemplates/issues/450, at least to understand what's going on. Currently, the customer reports that the following log is issued: ``` 2022-08-04 01:24:52.616 PDT Avro File Read Failure...
The current message doesn't display the current value, and doesn't imply that users can have control over it.
Supersedes https://github.com/GoogleCloudPlatform/DataflowTemplates/pull/1112
### Related Template(s) All ### What happened? Several errors are happening whenever the project's path has spaces. A few of them: ``` java.lang.IllegalArgumentException: Failed to match any files with the...
Internal issue b/308551181 There were conflicts related to the now legacy "enableStreamingEngine" parameter, and the top-level `enable_streaming_engine`. The provider was crashing when trying to use the inner parameter. ``` Stack...
Allow passing `launch_options` when using Terraform to manage Flex Templates, to allow customizing specific things such as `ft_vm_source_image` and `ft_launch_timeout_secs` when required by the customer. **Release Note Template for Downstream...
Adding a test to make sure usage of `enable_streaming_engine` does not regress **Release Note Template for Downstream PRs (will be copied)** ```release-note:none ```