[Failing Test]: PostCommit TransformService Direct Python 3.11 perma-red (transformServicePythonUsingJava)
What happened?
Action has never succeeded.
https://github.com/apache/beam/actions/workflows/beam_PostCommit_TransformService_Direct.yml?query=is%3Afailure
Locally:
./gradlew :sdks:python:test-suites:direct:xlang:transformServicePythonUsingJava --max-workers=8 --continue \
-Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses \
-PtestJavaVersion=11 \
-Pjava11Home=$JAVA_HOME_11_X64 \
-PuseWheelDistribution \
-PpythonVersion=3.11
Failure isn't very clear, but docker emits this warning
> Task :sdks:python:container:py311:docker
#16 writing image sha256:d93e9a7ac97620da2040ce62814cc3440f48c991ad649133d6d1f575065c34f3 done
#16 naming to docker.io/apache/beam_python3.11_sdk:2.55.0.dev done
#16 DONE 38.2s
1 warning found (use --debug to expand):
- Empty continuation line found in: RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install --upgrade pip setuptools wheel && pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._implementation_type == 'upb'; print ('Verified fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc && ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false && pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1) && pip freeze --all && rm -rf /root/.cache/pip
Which doesn't sound like a failure offhand.
Issue Failure
Failure: Test is continually failing
Issue Priority
Priority: 2 (backlog / disabled test but we think the product is healthy)
Issue Components
- [X] Component: Python SDK
- [X] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
cc: @chamikaramj to triage further or fix as appropriate.
The Jenkins was green last time I checked. Seems like it has been turned down ?
Github Actions version was migrated from the Jenkins test that I added initially but it started failing slightly some time after it was migrated.
https://github.com/apache/beam/pull/30243 fixes a naming conflict but might not fully fix the test suite.