beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
Performance change found in the test: `sideinpts_python_batch_10gb_1kb_10workers_1000window_first_iterable` for the metric: `runtime`. For more information on how to triage the alerts, please look at `Triage performance alert issues` section of the...
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
Performance change found in the test: `gbk_python_batch_load_test_2gb_of_100KB_records` for the metric: `runtime`. For more information on how to triage the alerts, please look at `Triage performance alert issues` section of the...
**Please** add a meaningful description for your change here fixes #31218 This PR contains these changes; - Added a new error handling for `ModuleNotFoundError` - no logging - Changed the...
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
We have gzipped text files in Google Cloud Storage that have the following metadata headers set: ``` Content-Encoding: gzip Content-Type: application/octet-stream ``` Trying to read these with apache_beam.io.ReadFromText yields the...
### What would you like to happen? ### Background GCS has introduced soft delete policy feature in new and existing buckets since March 2024. By default, the soft delete retention...
Java test `org.apache.beam.sdk.transforms.ViewTest` fails on Prism with error `panic: unsupported StateKey Get type: *fnexecution_v1.StateKey_MultimapKeysSideInput_`: Full error: ``` panic: unsupported StateKey Get type: *fnexecution_v1.StateKey_MultimapKeysSideInput_: multimap_keys_side_input: { transform_id: "OutputSideInputs-ParMultiDo-Anonymous-" side_input_id: "org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.:1443#bbafda9391edc490" }...
Java test `org.apache.beam.sdk.transforms.FlattenTest` fails on Prism with error `panic: nothing in progress and no refreshes with non zero pending elements`: Steps to reproduce. 1) Run Prism server. ``` ./gradlew :runners:prism:runServer...
Fixes #25598 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description...
Follow up for #31321
