beam icon indicating copy to clipboard operation
beam copied to clipboard

[Task][prism]: Be able to execute non-Go SDKs on Prism.

Open lostluck opened this issue 2 years ago • 0 comments

Backlink to global prism tracking issue: #29650

What needs to happen?

Umbrella task for tracking PRs to improve prism and get it to support non-go SDKs.

More targeted tasks should be filed for other work items, and linked here.

This includes

  • [x] Improving error output for Prism to make SDK or prism side failures clearer.
    • With rare exceptions, prism no longer crashes on certain failures, allowing errors to return to the calling runners. Other issues are around specific failure clarity that will be handled on a case by case basis.
  • [x] Improve general debugging capabilities for Prism.
    • [x] Execution time panics converted to errors to simplify user test output.
    • [x] Stage descriptor building time panics converted to errors to simplify user test output.
    • [x] Gracefully shutting down worker GRPC server to reduce spurious noise from SDKs.
  • [x] Docker environment support. [DONE #28444]
  • [x] Cross language / multiple environment support [DONE #28545].
  • [x] #29697
  • [x] #31402
    • [x] #31793
    • [ ] Run Java Validates Runner tests on Prism
      • Validates Runner Test Control file https://github.com/apache/beam/blob/master/runners/portability/java/build.gradle
    • [ ] Java Runner Wrapper to execute a job against Prism (via Go being available) for dev versions
  • [x] #31403
    • [x] #32637
    • [ ] #32877

lostluck avatar Aug 28 '23 18:08 lostluck