beam
beam copied to clipboard
Apache Beam is a unified programming model for Batch and Streaming data processing.
Upgrades mypy version to 1.7.1. Some files are yet to done and added to ignore list with github issue in mypyi.ini. ------------------------ Thank you for your contribution! Follow this checklist...
This PR adds support for reads and writes via Iceberg to the Java SDK. At the moment this isn't intended to be used as a standalone IO, but rather to...
### What would you like to happen? There are interests to leverage the new Vector API (AVX2 CPU instructions) in Java [1], which requires special JVM flags for activation (`--add-modules=jdk.incubator.vector`)....
### What happened? When using the inference of schema with a POJO, a Java Bean or an AutoValue class, the order of the fields in the schema may change during...
### What happened? The annotation `@SchemaFieldNumber` expects a String, but [the documentation shows an example using integers](https://beam.apache.org/releases/javadoc/2.53.0/org/apache/beam/sdk/schemas/annotations/SchemaFieldNumber.html). This is [how that annotation is used](https://github.com/apache/beam/blob/e9202abb7ad8b2041a257fb3f50337a2f03127b1/sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/FieldValueTypeInformation.java#L150) (with `parseInt` applied to a `String`),...
### What happened? To me, this is a really interesting corner case! Here's what's going on: I'm updating an operator in XArray-Beam https://github.com/google/xarray-beam/pull/69. I have a type that I've defined...
------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description (for example:...
The markdown content in the apache_beam/yaml package is now all available as part of the main beam documentation. ------------------------ Thank you for your contribution! Follow this checklist to help us...
### What happened? Using Beam Version 2.53 Cassandra version is currently 3.11.5 Using cassandra-driver-core & cassandra-driver-mapping 3.10.2 (also tested on 3.11.5 but no luck) CassandraIO.Read.withSsl expects an object that implements...
This is a follow-up to https://github.com/apache/beam/pull/30161 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate...