beam icon indicating copy to clipboard operation
beam copied to clipboard

[Task]: Yaml - fix kafka post commit test

Open derrickaw opened this issue 6 months ago • 3 comments

What needs to happen?

https://github.com/apache/beam/issues/35198

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

Issue Components

  • [ ] Component: Python SDK
  • [ ] Component: Java SDK
  • [ ] Component: Go SDK
  • [ ] Component: Typescript SDK
  • [ ] Component: IO connector
  • [x] Component: Beam YAML
  • [ ] Component: Beam examples
  • [ ] Component: Beam playground
  • [ ] Component: Beam katas
  • [ ] Component: Website
  • [ ] Component: Infrastructure
  • [ ] Component: Spark Runner
  • [ ] Component: Flink Runner
  • [ ] Component: Samza Runner
  • [ ] Component: Twister2 Runner
  • [ ] Component: Hazelcast Jet Runner
  • [ ] Component: Google Cloud Dataflow Runner

derrickaw avatar Jun 13 '25 14:06 derrickaw

When I enable the Kafka test again - see the familiar error that it times out waiting on the input queue - https://github.com/apache/beam/actions/runs/15638795625/job/44060801723?pr=35277.

derrickaw avatar Jun 13 '25 16:06 derrickaw

Tried adding option streaming:true, but same failure - https://github.com/apache/beam/actions/runs/15639543581/job/44063297013?pr=35277

derrickaw avatar Jun 13 '25 17:06 derrickaw

Opened https://github.com/apache/beam/pull/35277 to uncomment the WriteToKafka portion. Will need further investigation.

derrickaw avatar Jun 13 '25 17:06 derrickaw