beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
The PostCommit Java Examples Dataflow ARM is failing over 50% of the time. Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Examples_Dataflow_ARM.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs. See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=4&var-Workflow=PostCommit%20Java%20Examples%20Dataflow%20ARM
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
Once the summit is over I'll move this out of draft ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: -...
### What happened? _No response_ ### Issue Failure Failure: Test is flaky ### Issue Priority Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the...
Formerly the coder used was always a url-excaped pickling[1] of windowed values. This is quite inefficient in time and space. The default (text) sink is modified to use base64 encoding...
This is useful when one wants to capture and preserve all the windowing information for later use (and is both more convenient and less error-prone than gathering the timestamp, windows,...
1. Added _**SpannerReadSchemaTransformProvider.java**_, a provider for reading from spanner. 2. Modified **_SpannerWriteSchemaTransformProvider.java_** to incorporate error handling and fixed other issues. 3. Modified **_MutationUtils.java_** to add a function "createRowFromMutation" which creates...
There is a long time flaky test, see example: https://github.com/apache/beam/runs/29315435535 Originally it only considered ExecutionException -> RuntimeException -> InterruptedException, but InterruptedException at any stage is possible. **Please** add a meaningful...
Reverts apache/beam#32282
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
### What would you like to happen? I would like to request the implementation of a feature that allows for auto-detecting the schema when saving data in Parquet using Apache...
