beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
# Pull Request: Add PrimitiveUnboundedRead/PrimitiveBoundedRead Translators to Flink Runner ## Title `[Flink Runner] Add translators for PrimitiveUnboundedRead and PrimitiveBoundedRead` ## Description ### What is this PR doing? This PR adds...
Content generated from release 2.70.0-RC2.
This change enables a retry mechanism for `pytest` to improve the developer experience and the reliability of our test/release pipelines. Recently, we have observed an increase in flaky Python tests....
### What happened? Looking at workflow file: https://github.com/apache/beam/blob/e927f2d02c0fef783914708fbd3333cd3dda30bc/.github/workflows/beam_PreCommit_Python.yml#L114 It seems that we enabled a retry setting for pytest. However, when looking at the log (e.g. https://github.com/apache/beam/actions/runs/20010300018/job/57378762026), I don't see the...
### What would you like to happen? Current compat test suites first install test environment dependencies https://github.com/apache/beam/blob/76710e8e7345a37191b5c7498ec1eb91195748a6/sdks/python/tox.ini#L406, then install Beam, then run tests. This can create incompatible environments, since pip...
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
### What would you like to happen? It would be awesome to have the ability to specify output_type for [ReadFromBigQuery](https://beam.apache.org/releases/yamldoc/current/#readfrombigquery) Apache Beam YAML transform when using query. Currently attempt to...
### What needs to happen? Propagate context from windmill to windowedValue https://github.com/apache/beam/blob/81bb5066bab883f79328e52f0d2a55e9b90f2f65/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/UngroupedWindmillReader.java#L145 ### Issue Priority Priority: 2 (default / most normal work should be filed as P2) ### Issue Components...
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...