beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
As reported in #30273, the documentation of the SchemaFieldNumber annotation has an error. This PR fixes this error. Cheers, ------------------------ Thank you for your contribution! Follow this checklist to help...
Fixes #30276. Returning methods in lexicographical order will prevent non-deterministic schema inference. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:...
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
Some notes: - This is effectively a safe rollback of [pr/29482](https://github.com/apache/beam/pull/29482). - We will send this data through DFE instead of WMW. - User Workers are currently not populating these...
Testing the TransformService test failure. WIP ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate...
### What happened? Action has never succeeded. https://github.com/apache/beam/actions/workflows/beam_PostCommit_TransformService_Direct.yml?query=is%3Afailure Locally: ``` ./gradlew :sdks:python:test-suites:direct:xlang:transformServicePythonUsingJava --max-workers=8 --continue \ -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses \ -PtestJavaVersion=11 \ -Pjava11Home=$JAVA_HOME_11_X64 \ -PuseWheelDistribution \ -PpythonVersion=3.11 ``` Failure isn't...
### What needs to happen? Under #29669 The following uses an example driven approach via [gherkin syntax](https://cucumber.io/docs/gherkin/reference/) to describe drain behavior. ## Scenario: pipeline reads from Pub/Sub ```gherkin Given pipeline...
### What needs to happen? Try to implement [bert](https://www.kaggle.com/models/tensorflow/bert) from TensorflowHub using `TFModelHandlerTensor`. I get the error ``` ValueError: Unable to load the TensorFlow model: 'tuple' object has no attribute...
Addresses #28061 This PR adds a warning log, if the `process` method of `DoFn` returns `None` by checking the following cases (doesn't check inner functions): - `process` contains `return None`...
PR adds docs for UDF's to `yaml_mapping.md` and moves the UDF tests to `yaml_mapping_test.py`. Requires go/beam-pr/28114 be merged first. This should not be included as part of the 2.51.0 release....