beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
### What happened? When using `WithKeys.of().withKeyType(TypeDescriptor.of(TypeWithSchema.class)` for types annotated with `@DefaultSchema(JavaBeanSchema.class)`, Beam is not able to resolve the coder for the type, despite the schema being available. See also https://stackoverflow.com/questions/77575574/unable-to-return-a-default-coder-for-withkeys-when-using-defaultschemajavabean...
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.42.2 to 1.57.0. Commits 7c25c21 Release 2024-06-26 b374423 Regenerated Clients 923f54e Update API model 5f3bdfc track changes for string_array endpoint parameters (#2699) 2b4498c Release 2024-06-25 332d372 Regenerated...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.41.0 to 1.42.0. Commits 22e90d9 chore(main): release spanner 1.42.0 (#7130) 2552e09 fix(spanner): fallback to check grpc error message if ResourceType is nil for... 6bb95ef feat(spanner): add database...
Bumps [github.com/nats-io/nats-server/v2](https://github.com/nats-io/nats-server) from 2.10.12 to 2.10.17. Release notes Sourced from github.com/nats-io/nats-server/v2's releases. Release v2.10.17 Changelog Refer to the 2.10 Upgrade Guide for backwards compatibility notes with 2.9.x. Go Version 1.22.4...
The reshuffle adds a barrier so that the read records were committed before possibly committing offsets. However this is unnecessary as the DoFn is annotated with RequiresStableInput and the fusion...
Bumps [ws](https://github.com/websockets/ws) from 6.2.2 to 6.2.3. Release notes Sourced from ws's releases. 6.2.3 Bug fixes Backported e55e5106 to the 6.x release line (eeb76d31). Commits d87f3b6 [dist] 6.2.3 eeb76d3 [security] Fix...
Fix #31419 String sorting is more complex than integers / datetimes (the field can be alpha-numeric; base64; alphabetic; etc, and other scenarios). The solution here is to support custom JdbcReadWithPartitionsHelper....
### What happened? `WriteToBigQuery` with `STORAGE_WRITE_API` method can cause a pickling error [1] if 1. The `WriteToBigQuery` step is applied after a multi-output step 2. And, the pipeline variable is...
Fixes #26545, fixes #21529 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in...
Bumps [github.com/nats-io/nats-server/v2](https://github.com/nats-io/nats-server) from 2.10.12 to 2.10.16. Release notes Sourced from github.com/nats-io/nats-server/v2's releases. Release v2.10.16 Changelog Refer to the 2.10 Upgrade Guide for backwards compatibility notes with 2.9.x. [!WARNING] A possible...