Kenn Knowles
Kenn Knowles
[Task]: Improve how to handle the Dataflow-specific option `impersonateServiceAccount` for Beam Java
For this particular option, the dataflow service (the UW) should be the place where you remove the option. The Python SDK is a real mess when it comes to isolating...
Is this ready to merge?
Does this reproduce on runners other than Dataflow? Can we isolate it to the SDK harness (possibly a cache that keeps getting its invalidation re-upped?) or is it runner-specific? Maybe...
Nice find! I have seen quite a few disconnected issues around side input refresh in Python. I hope this is the real root cause.
Perhaps rebasing will get to green if there were issues on `master`?
I think it does not. The various merge and HEAD commits associated with a PR are, I think, only updated when the head commit of the PR changes. So reruns...
This was integrated into #30797 and #30805
How does it work for update compatibility if I add a new field to my POJO? I added Reuven because he knows the most about this.
Excellent. I was worried this would cause update incompatibility just as you described. But it sounds like it is fine. 👍
Just skimming this last comment, it sounds like this is related to the impetus to https://s.apache.org/beam-triggered-side-inputs Right now we have a combination of 1. "definition is whatever happens when you...