tvalentyn
tvalentyn
Run Python Dataflow ValidatesContainer
@phoerious please don't squash reviewed and unreviewed code until the review has finalized, see: https://beam.apache.org/contribute/#make-the-reviewers-job-easier
Looks like Dataflow's IT tests on prior iteration failed with: ``` 2022-03-04 18:49:15.451 PST "2022/03/05 02:49:15 Found artifact: dataflow_python_sdk.tar " Info 2022-03-04 18:49:15.451 PST "2022/03/05 02:49:15 Installing setup packages ......
Dataflow just spins up a docker container using kubelet, no special filesystem configuration. I am afraid you might not be able to see the logs since they require viewer access...
Let's make sure the error is still reproducible with latest changes
Run Python Dataflow ValidatesContainer
Looks like it indeed still fails. Actually, Dataflow does do some configuration. This may have to do with how the 'semi-persistent' directory is mounted into the container. I think in...
Unrelated: is the PR description up to date?
I'll take a look or find somebody who can help.
I spent some time debugging this today and got this far: Dataflow container pod for SDK container has the following mount (from container manifest): ``` "volumeMounts": [ { "mountPath": "/var/opt/google",...