beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
### What happened? Since the refactor of gcsio (2.52?) ReadAllFiles does not fully read gzipped files from GCS. Part of the file will be correctly returned but rest will go...
### What happened? I have a Batch pipeline that reads data from **Firestore** and writes it to **BigQuery** ``` pipeline .apply(Create.of("myCollection")) .apply("QueryRequest", ParDo.of(new QueryRequestFn(projectId, firestoreDatabaseId))) // Creates a RunQueryRequest .apply("ReadFromFirestore",...
The PostCommit Python is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python.yml?query=is%3Afailure+branch%3Amaster to see the logs.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
The PostCommit Sickbay Python is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Sickbay_Python.yml?query=is%3Afailure+branch%3Amaster to see the logs.
The PostCommit Go VR Flink is failing over 50% of the time. Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Go_VR_Flink.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs. See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=10&var-Workflow=PostCommit%20Go%20VR%20Flink
The PostCommit Python Arm is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Arm.yml?query=is%3Afailure+branch%3Amaster to see the logs.
The Inference Python Benchmarks Dataflow is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_Inference_Python_Benchmarks_Dataflow.yml?query=is%3Afailure+branch%3Amaster to see the logs.
The Playground CI Nightly is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_Playground_CI_Nightly.yml?query=is%3Afailure+branch%3Amaster to see the logs.
The PostCommit Java Nexmark Dataflow is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Nexmark_Dataflow.yml?query=is%3Afailure+branch%3Amaster to see the logs.
The PostCommit Java Sickbay is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Sickbay.yml?query=is%3Afailure+branch%3Amaster to see the logs.