beam

beam copied to clipboard

clean up some grpc error handling for windmill streams

5

Clean up some of the windmill stream error and stream handling R: @arunpandianp ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and...

m-trieu

The PostCommit XVR Spark3 job is flaky

1

The PostCommit XVR Spark3 is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_XVR_Spark3.yml?query=is%3Afailure+branch%3Amaster to see the logs.

github-actions[bot]

[WIP] try new protobuf

3

**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...

riteshghorse

Bump tqdm from 4.66.2 to 4.66.3 in /sdks/python/container/py38

4

Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.66.2 to 4.66.3. Release notes Sourced from tqdm's releases. tqdm v4.66.3 stable cli: eval safety (fixes CVE-2024-34062, GHSA-g7vv-2v7x-gj9p) Commits 4e613f8 Merge pull request from GHSA-g7vv-2v7x-gj9p b53348c cli:...

dependabot[bot]

### What happened? Part of refactoring of the commit path for StreamingDataflowWorker introduced a bug when the number of commit threads is increased via `windmillServiceCommitThreads` option. Previously we created a...

scwhittle

move heartbeat processor to where it is being used

1

Heartbeat response processor should be close to where it is being used as we don't change the heartbeat response processor at all. ------------------------ Thank you for your contribution! Follow this...

m-trieu

[Failing Test]: PreCommit YAML Xlang Direct fails on GHA

1

### What happened? Sample run: https://github.com/apache/beam/actions/runs/9087570294/job/24975542386 Stacktrace: INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory ``` INFO root:external.py:1017 Starting a JAR-based expansion service from JAR /runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service...

tvalentyn

Add ApplyBucketsWithInterpolation TFTransform

7

Implements the `apply_buckets_with_interpolation()` Tensorflow Transform into MLTransform. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the...

jrmccluskey

[Failing Test]: Beam ML unit tests fail with Keras 3.3.3 and TF 2.16.1

2

### What happened? Sample failure: ``` $ pytest apache_beam/ml/inference/tensorflow_inference_test.py::TFRunInferenceTest::test_predict_numpy_with_batch_size ================================================================================================================================== test session starts =================================================================================================================================== platform linux -- Python 3.9.18, pytest-7.4.4, pluggy-1.5.0 rootdir: /home/valentyn/projects/beam/beam/beam/sdks/python configfile: pytest.ini plugins: xdist-3.6.1, requests-mock-1.12.1, timeout-2.3.1, hypothesis-6.102.1...

tvalentyn

remove unused field

2

This field is unused it is only populated but never read and the 2 implementations of `DataflowWorkExecutor#extractMetricUpdates` return empty lists. ------------------------ Thank you for your contribution! Follow this checklist to...

m-trieu