beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
### What happened? Background: DualInputNestedValueProvider https://github.com/GoogleCloudPlatform/DataflowTemplates/blob/c7cb59f37766b7edfd0eb14f6f184f7c13b7909b/v1/src/main/java/com/google/cloud/teleport/util/DualInputNestedValueProvider.java#L29 is not in Apache Beam package. However, it uses ValueProvider from SDK. The issue: If one of the input for DualInputNestedValueProvider is RuntimeValueProvider, then...
PulsarIOTest uses shared client across all tests [1], which is a race conditions when multiple tests run in parallel. This manifests as frequent test failures. [1] https://github.com/apache/beam/blob/master/sdks/java/io/pulsar/src/test/java/org/apache/beam/sdk/io/pulsar/PulsarIOTest.java#L62 Imported from Jira...
### What happened? https://github.com/apache/beam/pull/30181 is looking to update Beam to utilize libraries-bom 26.31.0. This is causing a `NullPointerException` (https://github.com/apache/beam/actions/runs/7825861531/job/21350737985?pr=30181). My thoughts on a workaround: Sickbay the integration test, merge the...
Bumps [github.com/google/uuid](https://github.com/google/uuid) from 1.5.0 to 1.6.0. Release notes Sourced from github.com/google/uuid's releases. v1.6.0 1.6.0 (2024-01-16) Features add Max UUID constant (#149) (c58770e) Bug Fixes fix typo in version 7 uuid...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
# Feature: Throttle a PCollection _As a Beam developer, I want to slow down element throughput of an API request PCollection, so that I can minimize API overusage and save...
Adding 3 'golden' prompts about data encoding and type safety for Duet AI. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and...
### What happened? Example run: https://github.com/apache/beam/runs/21250090063 (an PR unrelated to Jms): ``` java.lang.AssertionError at org.junit.Assert.fail(Assert.java:87) at org.junit.Assert.assertTrue(Assert.java:42) at org.junit.Assert.assertTrue(Assert.java:53) at org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMark(JmsIOTest.java:463) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ``` Fails at here: https://github.com/apache/beam/blob/d5aa44c9ba9eb910774d789dd4182a5d25d8f552/sdks/java/io/jms/src/test/java/org/apache/beam/sdk/io/jms/JmsIOTest.java#L463 In...
Performance change found in the test: `pytorch_image_classification_benchmarks-resnet101-mean_load_model_latency_milli_secs` for the metric: `mean_load_model_latency_milli_secs`. For more information on how to triage the alerts, please look at `Triage performance alert issues` section of the...
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
Tests run on GHA should be queued shortly.
[Task]: Update beam_PostCommit_Java_IO_Performance_Tests.yml to select release branch automatically
### What needs to happen? beam_PostCommit_Java_IO_Performance_Tests.yml is hardcoded to the most recent release. This should be updated to query the Github releases endpoint, and automatically select the most recent release....
