beam
beam copied to clipboard
Apache Beam is a unified programming model for Batch and Streaming data processing.
**Please** add a meaningful description for your change here - fixes #19366 - better handling of parquet‑protobuf data by switching to ProtoParquetReader, and clearer configuration via display data ------------------------ Thank...
…large rows while reading from bigtable **Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution...
Fixes https://github.com/apache/beam/issues/30177 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description...
Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.29.14 to 1.29.16. Commits 983f192 Release 2025-06-10 a5c1277 Regenerated Clients a429911 Update endpoints model 4ea1cec Update API model 5b11c8d remove changelog directions for now because of #3107...
Bumps [github.com/aws/aws-sdk-go-v2/credentials](https://github.com/aws/aws-sdk-go-v2) from 1.17.67 to 1.17.69. Commits 983f192 Release 2025-06-10 a5c1277 Regenerated Clients a429911 Update endpoints model 4ea1cec Update API model 5b11c8d remove changelog directions for now because of #3107...
Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.17.74 to 1.17.79. Commits 983f192 Release 2025-06-10 a5c1277 Regenerated Clients a429911 Update endpoints model 4ea1cec Update API model 5b11c8d remove changelog directions for now because of #3107...
### What would you like to happen? Currently Spanner change streams are supported as a source in Java, there is no current support in Python. Would be great to see...
### What happened? Since ~2 weeks my streaming job started getting this error regularly. It happened again today with latest beam (2.63.0) running on GCP Dataflow. It makes the job...
### What happened? Similar to #24979 but handle the `with_batched_input` case. Users can batch their BQ rows and write a PCollection of batches to BigQuery. These batches can exceed the...
### What happened? Flaky Prism Runner unit tests in Java PreCommit Some recent added tests are flaky: prismReportsPAssertFailure (org.apache.beam.runners.prism.PrismRunnerTest) failed ``` java.lang.AssertionError: unexpected exception type thrown; expected: but was: at...