tvalentyn

@jrmccluskey are you still working on changes or you are waiting for a review (if so, please say explicitly that you have addressed previous comments, since current PR status seems...

@glasnt it appears you might have to submit a CLA for the github user id you've been using here, see: https://github.com/GoogleCloudPlatform/python-docs-samples/pull/11881/checks?check_run_id=27283317137

Is it still quota issues or something else?

``` =================================== FAILURES =================================== ____________________________ test_pipeline_dataflow ____________________________ Traceback (most recent call last): File "/workspace/dataflow/gemma-flex-template/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py", line 144, in retry_target result = target() File "/workspace/dataflow/conftest.py", line 167, in pubsub_wait_for_messages messages = [m.message.data.decode("utf-8")...

Some tests pass, some fail: ``` === RUN TestDirectParDo 2024/08/27 13:27:42 components:{transforms:{key:"e1" value:{unique_name:"Impulse" spec:{urn:"beam:transform:impulse:v1"} outputs:{key:"i0" value:"n1"}}} transforms:{key:"e2" value:{unique_name:"beam.createFn" spec:{urn:"beam:transform:pardo:v1" payload:"\n\x86\x02\n\x19beam:go:transform:dofn:v1\x1a\xe8\x01ChliZWFtOmdvOnRyYW5zZm9ybTpkb2ZuOnYxEo8BCm4SOwgYEjcIGkozZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL3YyL2dvL3BrZy9iZWFtLmNyZWF0ZUZuGi97InZhbHVlcyI6WyJBUUk9IiwiQVFRPSIsIkFRWT0iXSwidHlwZSI6IkNBST0ifRIMCAESCAoGCBQSAggIGggKBgoECBlADyIFUGFyRG8="} inputs:{key:"i0" value:"n1"} outputs:{key:"i0" value:"n2"} environment_id:"go"}} transforms:{key:"e3" value:{unique_name:"regression.directFn" spec:{urn:"beam:transform:pardo:v1" payload:"\n\xce\x01\n\x19beam:go:transform:dofn:v1\x1a\xb0\x01ChliZWFtOmdvOnRyYW5zZm9ybTpkb2ZuOnYxEmUKSgpICjpnaXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vdGVzdC9yZWdyZXNzaW9uLmRpcmVjdEZuEgoIFiICCAIqAggCEggIARIECgIIAhoGCgQKAggCIgVQYXJEbw=="} inputs:{key:"i0"...

Tried to repro locally: ```:beam$ gradlew :sdks:go:test:ulrValidatesRunner``` Suite seems to be stuck after 2hrs periodically emitting logs: ``` I0000 00:00:1724792615.011573 196526 fork_posix.cc:77] Other threads are currently calling into gRPC, skipping...

> Both oddly still call the container without the docker.io domain, so I don't think that's it. I think that's WAI: https://github.com/apache/beam/blob/9e3aeca6123463146f7ec8cd4fec855fb912d25c/sdks/go/pkg/beam/core/core.go#L33

Tests fail inconsistently, but entire workflow fails reliably. Occasionally, test don't fail but get stuck in and time out. Here is a sample of failures from past runs: ``` 2024-08-24T13:22:36.8054401Z...

Will try to downgrade GRPC IO, looks like it had a release around Aug 22 https://pypi.org/project/grpcio/#history

successful run: https://github.com/apache/beam/actions/runs/10839063060/job/30078643883?pr=32446 after placing an upper bound on grpcio: [ ddff883227ffa064ecaee1f3d308675da103812f](https://github.com/apache/beam/commit/ddff883227ffa064ecaee1f3d308675da103812f)