beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
includes https://github.com/apache/beam/pull/31148 StreamingDataflowWorker will eventually just be constructing the harness runtime (different implementations for appliance, dispatched, fanout etc) and the main method. R: @scwhittle ------------------------ Thank you for your contribution!...
### What happened? ``` > Task :sdks:python:test-suites:direct:py38:tensorflowInferenceTest FAILED File "", line 671, in _load_unlocked File "/runner/_work/beam/beam/build/gradleenv/1398941892/lib/python3.8/site-packages/_pytest/assertion/rewrite.py", line 186, in exec_module exec(co, module.__dict__) File "/runner/_work/beam/beam/build/gradleenv/1398941892/lib/python3.8/site-packages/typeguard/__init__.py", line 21, in from ._importhook import...
addresses #18110 Added a new configuration method `withConnectionFactoryProviderFn` to the JmsIO's Read and Write transforms, which enables the user to specify a lazily instantiated CF objects in case they're not...
### What would you like to happen? For large Java BQ batch loads that require copy jobs, the temp tables created for a given destination are [grouped up into a...
### What happened? #### Bug description Setup details: - FlinkRunner (Flink 1.15.4) (also replicated with Flink 1.18.2) - KinesisIO (from `beam-sdks-java-io-amazon-web-services2`) - Beam version 2.56.0 - Pipeline attached mode (false)...
The PostCommit XVR Samza is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_XVR_Samza.yml?query=is%3Afailure+branch%3Amaster to see the logs.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
The PostCommit XVR PythonUsingJavaSQL Dataflow is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow.yml?query=is%3Afailure+branch%3Amaster to see the logs.
------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description (for example:...
### What would you like to happen? Customers requested job names to be included in custom audit fields. ### Issue Priority Priority: 2 (default / most feature requests should be...
### What happened? According to the documentation https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/io/TextIO.html We can configure the behaviour of the read() method to also allow no matches or empty matches, so I configured a pipeline...
