beam
beam copied to clipboard
apache
Apache Beam is a unified programming model for Batch and Streaming data processing.
dev@ discussion: https://lists.apache.org/thread.html/r266f37640901544927205b913d4903340d6c59c3d94905e5dda0db42%40%3Cdev.beam.apache.org%3E PickleCoder should support out-of-band pickling to avoid unnecessary memory copies for types that support it (including numpy and pandas types). Imported from Jira [BEAM-12418](https://issues.apache.org/jira/browse/BEAM-12418). Original Jira may...
Changes CoGroupByKey to output an Iterable instead of a List. This will be a breaking change and I put together [a document](https://docs.google.com/document/d/1RIzm8-g-0CyVsPb6yasjwokJQFoKHG4NjRUcKHKINu0/edit#) to describe it. The documentation of CoGroupByKey is...
addresses #22206 by adding supporting PyTorch versions in docstrings of PytorchModelHandlerTensor as well as a reminder in tox.ini to update those docstrings if the supported versions of PyTorch change. ------------------------...
This PR is part of the migration from jenkins to github actions. This PR contains this tests Java PostCommit Nexmark Dataflow - Java 8 Java PostCommit Nexmark Dataflow Direct -...
As part of the migration of Precommit and Postcommit Jobs from Jenkins to GA in self-hosted runners, this PR contains: - Migrated workflow [job-postcommit-pythonusingjavasql-dataflow.yml](https://github.com/benWize/beam/blob/9cc7af8eb25865d25e7bfaed947efecca8b44415/.github/workflows/job-postcommit-pythonusingjavasql-dataflow.yml) - Migrated workflow [job-postcommit-xvr-samza.yml](https://github.com/benWize/beam/blob/9cc7af8eb25865d25e7bfaed947efecca8b44415/.github/workflows/job-postcommit-xvr-samza.yml) - Migrated...
As part of the migration of Precommit and Postcommit Jobs from Jenkins to GA in self-hosted runners, this PR contains: - Migrated and sharded workflow [job-precommit-java-mqtt-io.yml](https://github.com/benWize/beam/blob/88c5ba3e8649fd0f1661113c4ac6447fcb836d50/.github/workflows/job-precommit-java-mqtt-io.yml) - Migrated and sharded...
As part of the migration of Precommit and Postcommit Jobs from Jenkins to GA in self-hosted runners, this PR contains: Migrated workflow [job-precommit-python-dataflow-runners](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-dataflow-direct-interactive-runners/.github/workflows/job-precommit-python-dataflow-runners.yml) Migrated workflow [job-precommit-python-direct-runners](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-dataflow-direct-interactive-runners/.github/workflows/job-precommit-python-direct-runners.yml) Migrated workflow [job-precommit-python-interactive-runners](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-dataflow-direct-interactive-runners/.github/workflows/job-precommit-python-interactive-runners.yml) The...
As part of the migration of Precommit and Postcommit Jobs from Jenkins to GA in self-hosted runners, this PR contains: Migrated workflow [job-precommit-python-text-io.yml](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-text-tf-record-io/.github/workflows/job-precommit-python-text-io.yml) Migrated workflow [job-precommit-python-tfrecord-io.yml](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-text-tf-record-io/.github/workflows/job-precommit-python-tfrecord-io.yml) The migrated workflow was...
As part of the migration of Precommit and Postcommit Jobs from Jenkins to GA in self-hosted runners, this PR contains: Migrated workflow [job-precommit-python-parquet-io.yml](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-parquet-io/.github/workflows/job-precommit-python-parquet-io.yml) The migrated workflow was added to [CI.md](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-parquet-io/CI.md)...
As part of the migration of Precommit and Postcommit Jobs from Jenkins to GA in self-hosted runners, this PR contains: Migrated workflow [job-precommit-python-mongodb-io.yml](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-mongo-io/.github/workflows/job-precommit-python-mongodb-io.yml) The migrated workflow was added to [CI.md](https://github.com/fernando-wizeline/beam/blob/gam-precommit-python-sharding-mongo-io/CI.md)...