google-cloud-java icon indicating copy to clipboard operation
google-cloud-java copied to clipboard

IT Failure: Nightly build failures due to 3hr timeout

Open burkedavison opened this issue 1 year ago • 4 comments

April 8 - Nightly GraalVM JDK 11

  • Fails due to 3hr timeout in group 19
  • Ends during videointelligence.v1.it.ITSystemTest

April 9 - Nightly GraalVM JDK 11

  • Fails due to 3hr timeout in group 19
  • Ends during videointelligence.v1p2beta1.it.ITSystemTest

April 8 - Nightly GraalVM JDK 17

  • Fails due to 3hr timeout in group 19
  • Ends during videointelligence.v1p1beta1.it.ITSystemTest

April 9 - Nightly GraalVM JDK 17

  • Fails due to 3hr timeout in group 19
  • Ends during videointelligence.v1p1beta1.it.ITSystemTest

burkedavison avatar Apr 10 '23 13:04 burkedavison

The service was unresponsive at that time?

08:05:55:444 [INFO] --- maven-surefire-plugin:2.22.2:test (default-test) @ google-cloud-video-intelligence ---
08:05:55:451 [INFO]
08:05:55:451 [INFO] -------------------------------------------------------
08:05:55:451 [INFO]  T E S T S
08:05:55:452 [INFO] -------------------------------------------------------
08:05:55:486 [WARNING] Corrupted STDOUT by directly writing to native stream in forked JVM 1. See FAQ web page and the dump file /tmpfs/src/github/google-cloud-java/java-video-intelligence/google-cloud-video-intelligence/target/surefire-reports/2023-04-08T07-30-04_952-jvmRun1.dumpstream
08:05:56:712 [INFO] Running com.google.cloud.videointelligence.v1.it.ITSystemTest


ERROR: Aborting VM command due to timeout of 10800 seconds



[ID: 4999905] Command finished after 10815 secs, exit value: 1

suztomo avatar Apr 10 '23 14:04 suztomo

The latest build passed "Run Date | Monday, April 10, 2023 at 3:01:06 AM EDT" for prod:cloud-devrel/client-libraries/java/google-cloud-java/nightly/graalvm-sub-jobs/native/graalvm-native-19 and Monday, April 10, 2023 at 3:00:24 AM EDT for prod:cloud-devrel/client-libraries/java/google-cloud-java/nightly/graalvm-native-17.

suztomo avatar Apr 10 '23 15:04 suztomo

We keep this issue open to track flakiness.

suztomo avatar Apr 10 '23 17:04 suztomo

Keeping this issue open. Setting priority to P3.

lqiu96 avatar Jun 28 '23 17:06 lqiu96

@burkedavison @mpeddada1 These nightly builds are still failing pretty regularly. Do you know if it's for the same reason?

meltsufin avatar Mar 19 '24 01:03 meltsufin

No - they're currently failing due to the standard vision ITs.

burkedavison avatar Mar 19 '24 13:03 burkedavison