beam
beam copied to clipboard
[Task][prism]: Be able to execute non-Go SDKs on Prism.
Backlink to global prism tracking issue: #29650
What needs to happen?
Umbrella task for tracking PRs to improve prism and get it to support non-go SDKs.
More targeted tasks should be filed for other work items, and linked here.
This includes
- [x] Improving error output for Prism to make SDK or prism side failures clearer.
- With rare exceptions, prism no longer crashes on certain failures, allowing errors to return to the calling runners. Other issues are around specific failure clarity that will be handled on a case by case basis.
- [x] Improve general debugging capabilities for Prism.
- [x] Execution time panics converted to errors to simplify user test output.
- [x] Stage descriptor building time panics converted to errors to simplify user test output.
- [x] Gracefully shutting down worker GRPC server to reduce spurious noise from SDKs.
- [x] Docker environment support. [DONE #28444]
- [x] Cross language / multiple environment support [DONE #28545].
- [x] #29697
- [x] #31402
- [x] #31793
- [ ] Run Java Validates Runner tests on Prism
- Validates Runner Test Control file https://github.com/apache/beam/blob/master/runners/portability/java/build.gradle
- [ ] Java Runner Wrapper to execute a job against Prism (via Go being available) for dev versions
- [x] #31403
- [x] #32637
- [ ] #32877