beam icon indicating copy to clipboard operation
beam copied to clipboard
verified publisher icon apache

[Failing Test]: PreCommit YAML Xlang Direct fails on GHA

Open tvalentyn opened this issue 1 year ago • 1 comments

What happened?

Sample run: https://github.com/apache/beam/actions/runs/9087570294/job/24975542386

Stacktrace:

INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory

INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR /runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar' '41523' '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar' '--alsoStartLoopbackWorker']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at org.apache.beam.sdk.expansion.service.ExpansionService.<clinit>(ExpansionService.java:115)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Caused by: java.lang.ClassNotFoundException: org.slf4j.LoggerFactory
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	... 1 more
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:174 Started job service with ['java', '-jar', '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '41523', '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '--alsoStartLoopbackWorker']
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:188 Error bringing up service
Traceback (most recent call last):
  File "/runner/_work/beam/beam/sdks/python/apache_beam/utils/subprocess_server.py", line 175, in start
    raise RuntimeError(
RuntimeError: Service failed to start up with error 1
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:339 Unknown pipeline options received: -v,apache_beam/yaml/integration_tests.py,--deselect,apache_beam/yaml/integration_tests.py::BigqueryTest::test_ReadFromBigQuery_ExternalJavaProvider_0. Ignore if flags are used for internal purposes.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:364 Discarding flag -v, single dash flags are not allowed.
INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR /runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar 
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:174 Started job service with ['java', '-jar', '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '41523', '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '--alsoStartLoopbackWorker']
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:188 Error bringing up service

More failures: https://github.com/apache/beam/actions/workflows/beam_PreCommit_Yaml_Xlang_Direct.yml

Issue Failure

Failure: Test is permared

Issue Priority

Priority: 1

Issue Components

  • [ ] Component: Python SDK
  • [ ] Component: Java SDK
  • [ ] Component: Go SDK
  • [ ] Component: Typescript SDK
  • [ ] Component: IO connector
  • [ ] Component: Beam YAML
  • [ ] Component: Beam examples
  • [ ] Component: Beam playground
  • [ ] Component: Beam katas
  • [ ] Component: Website
  • [ ] Component: Spark Runner
  • [ ] Component: Flink Runner
  • [ ] Component: Samza Runner
  • [ ] Component: Twister2 Runner
  • [ ] Component: Hazelcast Jet Runner
  • [ ] Component: Google Cloud Dataflow Runner

tvalentyn avatar May 15 '24 00:05 tvalentyn

Couldn't repro locally. gradlew :sdks:python:yamlIntegrationTests passed for me.

tvalentyn avatar May 15 '24 00:05 tvalentyn

Looks like this is back to green - https://github.com/apache/beam/actions/workflows/beam_PreCommit_Yaml_Xlang_Direct.yml?query=event%3Aschedule and probably safe to close? @tvalentyn feel free to reopen if you disagree

damccorm avatar Jun 14 '24 12:06 damccorm