beam
beam copied to clipboard
Apache Beam is a unified programming model for Batch and Streaming data processing.
DO NOT MERGE ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your...
------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description (for example:...
### What would you like to happen? These were added at https://github.com/apache/beam/pull/32445 This will increase their discovery. ### Issue Priority Priority: 2 (default / most feature requests should be filed...
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
TODO: more info will be added here. GitHub Actions Tests Status (on master branch) ------------------------------------------------------------------------------------------------ [](https://github.com/apache/beam/actions?query=workflow%3A%22Build+python+source+distribution+and+wheels%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Python+Tests%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Java+Tests%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Go+tests%22+branch%3Amaster+event%3Aschedule) See [CI.md](https://github.com/apache/beam/blob/master/CI.md) for...
This change does two tasks: * Enables Python SDK developers to have prism automatically build and run locally using local changes to Prism when using PrismRunner. * Sets Prism to...
This was done with com2ann plus some manaual edits. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
Users may update the table's spec while a write pipeline is running (e.g. streaming). Sometimes, this update can happen after serializing DataFiles. The partition spec is not serializable so we...
### What happened? A Streaming pipeline continuously fires the below RuntimeException when the partition layout of an Iceberg table is modified during execution. ``` SEVERE: 2024-10-18T13:53:19.171Z: java.lang.RuntimeException: org.apache.beam.sdk.util.UserCodeException: java.lang.IllegalStateException: Invalid...
Like it says on the tin: Make it so Prism isn't awful to use for Beam developers.