beam
beam copied to clipboard
Apache Beam is a unified programming model for Batch and Streaming data processing.
**Please** add a meaningful description for your change here ------------------------ Fixes: #19062 Compute transforms in topological order with `QueryablePipeline` and use a `LoadingCache` keyed by descriptor id to avoid recomputing....
### What happened? # GitHub Issue: Flink Runner - No translator known for PrimitiveUnboundedRead after SDF fallback ## Title `[Flink Runner] No translator known for PrimitiveUnboundedRead after SDF-to-primitive-read conversion` ##...
Stacked on top of https://github.com/apache/beam/pull/37009 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue...
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.5.0 to 2.6.0. Release notes Sourced from urllib3's releases. 2.6.0 🚀 urllib3 is fundraising for HTTP/2 support urllib3 is raising ~$40,000 USD to release HTTP/2 support and...
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.5.0 to 2.6.0. Release notes Sourced from urllib3's releases. 2.6.0 🚀 urllib3 is fundraising for HTTP/2 support urllib3 is raising ~$40,000 USD to release HTTP/2 support and...
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.5.0 to 2.6.0. Release notes Sourced from urllib3's releases. 2.6.0 🚀 urllib3 is fundraising for HTTP/2 support urllib3 is raising ~$40,000 USD to release HTTP/2 support and...
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.5.0 to 2.6.0. Release notes Sourced from urllib3's releases. 2.6.0 🚀 urllib3 is fundraising for HTTP/2 support urllib3 is raising ~$40,000 USD to release HTTP/2 support and...
### What happened? We are getting an error running our Apache Beam pipeline in Dataflow (v2 runners) using the managed transform for iceberg in python (cross-language). The dataflow job fails...
Fixes #36989 DynamicDestinationsHelper.ConstantTimePartitioningClusteringDestinations is parsing per element json configuration for partitioning and clustering which is expensive. Cache the outcome of evaluation so it's done once. ------------------------ Thank you for your...
Increase supported pyarrow version up to the latest one.