beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
### What would you like to happen? To my knowledge, there is no way to write protocol buffers to BigQuery using the Python SDK. I am currently writing them by...
Remove the budget distributor thread and move the managing of each server's internal budget to the direct GetWorkStream. R: @arunpandianp @scwhittle ------------------------ Thank you for your contribution! Follow this checklist...
A blog post explaining Beam YAML's streaming capabilities, showcasing how to handle Protobuf events. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly...
### What happened? Python 3.12 introduced the `type` [statement](https://docs.python.org/3/library/typing.html#typing.TypeAliasType) to define type aliases. Using the `type` statement with `apache-beam` 2.60.0 generates an error however: ```python TypeError: Type hints for a...
Fix for tableExists() method that causes a Spanner Change Stream consumer to be unable to recover from a restart. fixes #32509 ------------------------ See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on...
Start and closing Windmill streams are currently via `halfClose()` and on stream creation. Implementations were previously created and returned in a "started" state usually after the stream has already sent...
Add direct path code branch R: @scwhittle @arunpandianp ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention...
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.44.0 to 1.45.0. Release notes Sourced from cloud.google.com/go/storage's releases. storage: v1.45.0 1.45.0 (2024-10-17) Features storage/internal: Adds support for restore token (70d82fe) storage: Adding bucket-specific dynamicDelay (#10987) (a807a7e)...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [github.com/fsouza/fake-gcs-server](https://github.com/fsouza/fake-gcs-server) from 1.49.2 to 1.50.2. Release notes Sourced from github.com/fsouza/fake-gcs-server's releases. v1.50.2 What's Changed Revert "fakestorage: remove unused type" by @fsouza in fsouza/fake-gcs-server#1782 Full Changelog: https://github.com/fsouza/fake-gcs-server/compare/v1.50.1...v1.50.2 v1.50.1 What's Changed...
Bumps [github.com/nats-io/nats-server/v2](https://github.com/nats-io/nats-server) from 2.10.18 to 2.10.22. Release notes Sourced from github.com/nats-io/nats-server/v2's releases. Release v2.10.22 Changelog Refer to the 2.10 Upgrade Guide for backwards compatibility notes with 2.9.x. Go Version 1.22.8...