beam icon indicating copy to clipboard operation
beam copied to clipboard

The PostCommit XVR Samza job is flaky

Open github-actions[bot] opened this issue 1 year ago • 1 comments

The PostCommit XVR Samza is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_XVR_Samza.yml?query=is%3Afailure+branch%3Amaster to see the logs.

github-actions[bot] avatar Mar 11 '24 18:03 github-actions[bot]

Reopening since the workflow is still flaky

github-actions[bot] avatar May 16 '24 03:05 github-actions[bot]

Reopening since the workflow is still flaky

github-actions[bot] avatar May 26 '24 03:05 github-actions[bot]

looks like thus time the breakage is due to python3.12 support:

File "/tmp/bootstrap_beam_venv7899546459285591331.py", line 33, in from pkg_resources import parse_version ModuleNotFoundError: No module named 'pkg_resources'

Abacn avatar May 26 '24 15:05 Abacn

The error is found elsewhere: https://github.com/ManimCommunity/manim/issues/3585 and is said to due to https://peps.python.org/pep-0668/ .

Abacn avatar Jun 03 '24 15:06 Abacn

Reopening since the workflow is still flaky

github-actions[bot] avatar Nov 24 '24 21:11 github-actions[bot]

Single test failing - test_zetasql_generate_data. This is due to zetasql version bump #32902 . Samza test can only run on Java8, while newer zetasql does not support Java8

apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "grpc-default-executor-0" java.lang.NoSuchMethodError: java.util.Map.entry(Ljava/lang/Object;Ljava/lang/Object;)Ljava/util/Map$Entry;
    at com.google.zetasql.Type.<clinit>(Type.java:55)
    at com.google.zetasql.TypeFactory$1.apply(TypeFactory.java:123)
    at com.google.zetasql.TypeFactory$1.apply(TypeFactory.java:120)
  	at com.google.common.collect.Maps.toMap(Maps.java:1277)
    at com.google.common.collect.Maps.toMap(Maps.java:1255)
 	at com.google.zetasql.TypeFactory.<clinit>(TypeFactory.java:118)
 	at com.google.zetasql.AllowedHintsAndOptions.addDefaultAnonymizationOptions(AllowedHintsAndOptions.java:564)
 	at com.google.zetasql.AllowedHintsAndOptions.<init>(AllowedHintsAndOptions.java:107)
 	at com.google.zetasql.AnalyzerOptions.<init>(AnalyzerOptions.java:59)
 	at org.apache.beam.sdk.extensions.sql.zetasql.SqlAnalyzer.baseAnalyzerOptions(SqlAnalyzer.java:138)

Abacn avatar Nov 25 '24 15:11 Abacn

Map.entry is an API for Java 9+

https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Map.html#entry(K,V)

Update: opened #33213 for fix

Abacn avatar Nov 25 '24 15:11 Abacn

Job has been stable for 2 months. Closing as resolved.

Amar3tto avatar Jan 13 '25 06:01 Amar3tto

Reopening since the workflow is still flaky

github-actions[bot] avatar Mar 26 '25 03:03 github-actions[bot]

Fixed by https://github.com/apache/beam/pull/34439

Amar3tto avatar Mar 27 '25 05:03 Amar3tto