beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
The PostCommit Java ValidatesRunner Samza is failing over 50% of the time. Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Samza.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs. See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=3&var-Workflow=PostCommit%20Java%20ValidatesRunner%20Samza
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
### What would you like to happen? FlinkRunner's OrderedListState (i.e. FlinkOrderedListState) does not have an implementation of equals, hashCode, unlike other States in FlinkRunner. Before starting to write tests for...
### What would you like to happen? As the number of state operators in Apache Beam grows, we need to update the existing StateInternalsTest. Currently, tests exist for ValueState, BagState,...
Fixes #21162 I wasn't able to use the existing `PubsubMessageWithAttributesAndMessageIdCoder` because it doesn't encode/decode the message's topic, which is needed for dynamic destinations. There are already a number of existing...
Add support for configuring [SessionPoolOptions](https://googleapis.dev/nodejs/spanner/latest/google.spanner.executor.v1.SessionPoolOptions.html) in SpannerAccessor. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the...
Fixes #29577 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description...
Under #29650. # Why is this needed While most pipelines should naturally run to termination, successfully or not, it should be possible to abort pipeline execution by Prism in two...
This PR closes #31703 by scaffolding the CsvIOParseHelpers. This enables the method implementations to happen in parallel PRs. ------------------------ Thank you for your contribution! Follow this checklist to help us...
### What needs to happen? Create a helper method within [CsvIOParseHelpers](https://github.com/apache/beam/issues/31703) that parses a cell String of a CSV record based on the [Schema.FieldType](https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/schemas/Schema.FieldType.html). ### Issue Priority Priority: 2 (default...
### What needs to happen? Create a helper method within the [CsvIOParseHelpers](https://github.com/apache/beam/issues/31703) class for validating the [CSVFormat](https://javadoc.io/doc/org.apache.commons/commons-csv/1.8/org/apache/commons/csv/CSVFormat.html) in relation to the [Schema](https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/schemas/Schema.html) of the CSV records being parsed. ### Issue...