beam
beam copied to clipboard
Apache Beam is a unified programming model for Batch and Streaming data processing.
1. Added a simple bigtable enrichment example 2. Added an end to end use case that demonstrates how spanner IO and enrichment transform coupled with other YAML transforms can be...
Added examples with explanatory comments for reading from and writing to a spanner table ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly...
Python 3.8 is scheduled to reach EOL in October of 2024. This PR removes actions targets for 3.8 ahead of the removal of Beam support for 3.8. DO NOT MERGE...
**Please** add a meaningful description for your change here fixes #19378 This PR contains thease changes - add `ValueProvider` methods for `MqttIO.ConnectionConfiguration` ------------------------ Thank you for your contribution! Follow this...
Bumps commons-cli:commons-cli from 1.8.0 to 1.9.0. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
1. Added enrichment transform 2. Registered it in standard_providers.yaml 3. Added integration and unit tests for enrichment transform ------------------------ Thank you for your contribution! Follow this checklist to help us...
Bumps [cloud.google.com/go/datastore](https://github.com/googleapis/google-cloud-go) from 1.17.1 to 1.19.0. Release notes Sourced from cloud.google.com/go/datastore's releases. functions: v1.19.0 1.19.0 (2024-08-20) Features functions: Add support for Go 1.23 iterators (84461c0) kms: v1.19.0 1.19.0 (2024-08-20) Features...
### What would you like to happen? Currently the website only has examples for Java and Go: https://beam.apache.org/documentation/programming-guide/#metrics ### Issue Priority Priority: 2 (default / most feature requests should be...
### What would you like to happen? In Bigquery write introduce method "fetchSchemaFromObject" which will dynamically generate schema json from the supplied POJO class. BigQueryIO.write() .to(tableSpec) .fetchSchemaFromObject(Person.class) ..withFormatFunction( (Person elem)...
Imported from Jira [BEAM-6938](https://issues.apache.org/jira/browse/BEAM-6938). Original Jira may contain additional context. Reported by: iemejia.