beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
Just a nit that drives my brain nuts. Also it scrolls more characters off the end of the job name so makes GitHub UI annoying. Methodology: - search and replace...
This reverts commit ece456c1a91d1b2af50b5a9e9f88eb2a701ccb78. **Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and...
[Failing Test]: YAML integration tests are flaky as a result of failing to start expansion service
### What happened? Some of the yaml tests attached below are flaky. We can probably add a retry strategy to start the expansion service for these tests-  Latest run...
### What happened? [PostCommit Python](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python.yml) and [PostCommit Python Arm](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Arm.yml) in perma red status. ### Issue Failure Failure: Test is flaky ### Issue Priority Priority: 2 (backlog / disabled test but...
The `JmsIO` uses JMS `ConnectionFactory` as configuration. Unfortunately, `ConnectionFactory` interface doesn't extend `Serializable` (even if most of the implementations are `Serializable`). Instead (as I'm doing for the `JdbcIO`), I propose...
I'm sorry for opening an issue for this, but I didn't find a link to join the slack or in the docs
Apache Beam recommends to use Fakes instead of Mocks, since Mocks cannot serialize over the pipeline. I am writing unit tests for older code, where the class is using Apache...
Previously, the spotless things were only configured for Java projects. But spotless is actually a generic idempotent formatter for any context. This separates the java configuration into our java modules...
We do not allow types such as: https://godoc.org/cloud.google.com/go/datastore#Key Use of these will require type registration. Imported from Jira [BEAM-3864](https://issues.apache.org/jira/browse/BEAM-3864). Original Jira may contain additional context. Reported by: herohde.
### What happened? Due to test configuration issues, the tests were not part of tox unit test suite. Enabling them causes failures: ``` FAILED apache_beam/ml/inference/onnx_inference_test.py::OnnxPytorchRunInferencePipelineTest::test_invalid_input_type - AttributeError: 'TestOnnxModelHandler' object has...
