beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
# Summary Enable the use of a `--target` flag when applying [multi-stage builds](https://docs.docker.com/build/building/multi-stage/#use-a-previous-stage-as-a-new-stage) when building container images using docker. # Blockers - [ ] #32819 # Measures of Done -...
### What happened? Example run: https://github.com/apache/beam/actions/runs/11352551723 Failed with dependency resolution involving maven staging repository ``` Failed to execute goal on project word-count-beam: Could not resolve dependencies for project org.example:word-count-beam:jar:0.1: Failed...
This is a placeholder tracker for future work to add [distroless](https://github.com/GoogleContainerTools/distroless) support for Beam ML workloads.
# Summary This issue tracks the feature to add [distroless](https://github.com/GoogleContainerTools/distroless) support to new and variants of existing Beam container images. # Measures of Done - [ ] #32816 - [...
# Summary Enable [BuildKit](https://docs.docker.com/build/buildkit/) and [multi-stage](https://docs.docker.com/build/building/multi-stage/#use-a-previous-stage-as-a-new-stage) build support for container images. This enables reuse of existing Dockerfiles when enabling [distroless](https://github.com/GoogleContainerTools/distroless) variants. # Measures of Done - [ ] #32819 -...
Refers to #26329, also fix #20100, #21076 When using `readWithDatumReader` and `DIRECT_READ` method, the transform would fail because the `parseFn` is expected. Refactor the IO so the avro `datumReader` can...
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
Removes Python 3.8 support from Apache Beam and cleans up a number of references to the version. Also stops building 3.8 snapshot containers. DO NOT MERGE while 2.60 release is...
The PostCommit Python Xlang IO Direct is failing over 50% of the time. Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Xlang_IO_Direct.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs. See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=7&var-Workflow=PostCommit%20Python%20Xlang%20IO%20Direct
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
The PostCommit Python Examples Flink is failing over 50% of the time. Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Examples_Flink.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs. See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=8&var-Workflow=PostCommit%20Python%20Examples%20Flink