beam icon indicating copy to clipboard operation
beam copied to clipboard

[Feature Request]: managed IO connector for Apache Iceberg to offer Configurable Write Options for Target Table

Open eder001 opened this issue 11 months ago • 1 comments

What would you like to happen?

Current Limitation: The managed IO connector for Apache Iceberg currently only supports appending data to tables, limiting users to a single write option. Requirement: Introduce additional write options—specifically overwrite, append, and update—for Dataflow’s Iceberg connector, mirroring the write modes Spark offers for Iceberg integration.

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

  • [ ] Component: Python SDK
  • [ ] Component: Java SDK
  • [ ] Component: Go SDK
  • [ ] Component: Typescript SDK
  • [x] Component: IO connector
  • [ ] Component: Beam YAML
  • [ ] Component: Beam examples
  • [ ] Component: Beam playground
  • [ ] Component: Beam katas
  • [ ] Component: Website
  • [ ] Component: Infrastructure
  • [ ] Component: Spark Runner
  • [ ] Component: Flink Runner
  • [ ] Component: Samza Runner
  • [ ] Component: Twister2 Runner
  • [ ] Component: Hazelcast Jet Runner
  • [ ] Component: Google Cloud Dataflow Runner

eder001 avatar Jan 15 '25 17:01 eder001

This issue has been marked as stale due to 150 days of inactivity. It will be closed in 30 days if no further activity occurs. If you think that’s incorrect or this issue still needs to be addressed, please simply write any comment. If closed, you can reopen the issue at any time. Thank you for your contributions.

github-actions[bot] avatar Jun 15 '25 12:06 github-actions[bot]

This issue has been closed due to lack of activity. If you think that is incorrect, you can reopen the issue at any time.

github-actions[bot] avatar Jul 15 '25 12:07 github-actions[bot]