beam
beam copied to clipboard
Apache Beam is a unified programming model for Batch and Streaming data processing.
Issue link: https://github.com/apache/beam/issues/34905 Updated Python State Doc to provide more clarity. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: -...
## Upstream 🔗 [Apache JIRA: GSOC-279](https://issues.apache.org/jira/browse/GSOC-279) 🔗 [GSoC 2025 - Project Page](https://summerofcode.withgoogle.com/programs/2025/projects/X32yGjqz) ## Mentor Mentor: Danny McCormick GitHub Handle: @damccorm ## Legend - ⬜: Not started yet - ⚪: Feedback...
### What would you like to happen? I tried to run Dataflow Job in k8s job. I received the following error ``` goroutine 1 [running]: github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/xlangx/expansionx.newJarGetter() /go/pkg/mod/github.com/apache/beam/sdks/[email protected]/go/pkg/beam/core/runtime/xlangx/expansionx/download.go:56 +0x23 github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/xlangx/expansionx.init() /go/pkg/mod/github.com/apache/beam/sdks/[email protected]/go/pkg/beam/core/runtime/xlangx/expansionx/download.go:45...
### What would you like to happen? Current Limitation: The managed IO connector for Apache Iceberg currently only supports appending data to tables, limiting users to a single write option....
## Description - [ ] Design Doc Weaviate Integration - [ ] Source Connector - [ ] Sink Connector - [ ] Enrichment Handler - [ ] Unit Test -...
**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...
# GSoC 2025 Progress Tracker **Student:** [Canyu CHEN] ([@Chenzo1001](https://github.com/Chenzo1001)) **Mentors:** [XQ Hu] ([@liferoad](https://github.com/liferoad)) **Organization:** [Apache Beam] **Proposal Link:** [Here](https://summerofcode.withgoogle.com/media/user/a0dca52853b4/proposal/gAAAAABoPn1Vt4nIBnqceN9xDgbsdmh0JepoDkQBMM16v3qHKpfqftwWZEPk4qOLUZ4CxAzDuHitiF1q_e11s0FdVJBIi8LuMqdbAkkJ1WsKFBUu5rH2DbI=.pdf) ## 📌 Project Overview BeamVision transforms Apache Beam pipeline development in...
Fixes #35192. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description...
fixes #35269 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description...
### What would you like to happen? I would like to be able to have `ReadFromPubSub` understand that an incoming field in my message payload might be null, and that's...