openj9 icon indicating copy to clipboard operation
openj9 copied to clipboard

java_util_logging_CheckZombieLockTest Unexpected lock files found

Open pshipton opened this issue 4 years ago • 64 comments

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_windows_Nightly/3 win2012r2-x86-2 java/util/logging/CheckZombieLockTest.java.CheckZombieLockTest (from java_util_logging_CheckZombieLockTest.java)

WARNING: unable to delete/cleanup writable test directory: C:\\temp\\writable-lockfile-dir\\log.log
WARNING: unable to delete/cleanup writable test directory: C:\\temp\\writable-lockfile-dir\\log.log.lck
WARNING: unable to delete/cleanup writable test directory: C:\\temp\\writable-lockfile-dir
WARNING: unable to delete/cleanup writable test directory: C:\\temp\\writable-lockfile-dir\\log.log
WARNING: unable to delete/cleanup writable test directory: C:\\temp\\writable-lockfile-dir\\log.log.lck
WARNING: unable to delete/cleanup writable test directory: C:\\temp\\writable-lockfile-dir
java.lang.RuntimeException: Unexpected lock files found: []
	C:\\temp\\writable-lockfile-dir\\log.log.lck should not have been reused
	at CheckZombieLockTest.testFileHandlerReuse(CheckZombieLockTest.java:257)
	at CheckZombieLockTest.runTests(CheckZombieLockTest.java:105)
	at CheckZombieLockTest.main(CheckZombieLockTest.java:78)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.sun.javatest.regtest.agent.MainWrapper$MainThread.run(MainWrapper.java:127)
	at java.base/java.lang.Thread.run(Thread.java:834)

JavaTest Message: Test threw exception: java.lang.RuntimeException: Unexpected lock files found: []
	C:\\temp\\writable-lockfile-dir\\log.log.lck should not have been reused
JavaTest Message: shutting down test

STATUS:Failed.`main' threw exception: java.lang.RuntimeException: Unexpected lock files found: [] C:\\temp\\writable-lockfile-dir\\log.log.lck should not have been reused

pshipton avatar Apr 08 '20 15:04 pshipton

3x grinder on the same machine https://ci.eclipse.org/openj9/job/Grinder/761/ - passed

pshipton avatar Apr 08 '20 16:04 pshipton

Occurred on jdk-11.0.7+10 GA build: https://ci.adoptopenjdk.net/job/Test_openjdk11_j9_sanity.openjdk_x86-64_windows_xl/188/consoleFull

lumpfish avatar Apr 16 '20 17:04 lumpfish

Occurred on a nightly build https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_x86-64_windows_xl/191/

Exclude PR https://github.com/AdoptOpenJDK/openjdk-tests/pull/1740

M-Davies avatar Apr 20 '20 09:04 M-Davies

Re-occurred: https://ci.adoptopenjdk.net/job/Test_openjdk14_j9_sanity.openjdk_ppc64_aix/114/testReport/junit/java_util_logging_CheckZombieLockTest/java/CheckZombieLockTest/

andrew-m-leonard avatar Jun 29 '20 09:06 andrew-m-leonard

Occurred in a JDK16 internal build Test_openjdknext_j9_sanity.openjdk_ppc64_aix_Nightly/232:

22:28:13  openjdk version "16-internal" 2021-03-16
22:28:13  OpenJDK Runtime Environment (build 16-internal+0-adhoc.jenkins.BuildJDKnextppc64aixNightly)
22:28:13  Eclipse OpenJ9 VM (build master-c2d4f396055, JRE 16 AIX ppc64-64-Bit Compressed References 20200922_334 (JIT enabled, AOT enabled)
22:28:13  OpenJ9   - c2d4f396055
22:28:13  OMR      - 4c2d9a1f1c2
22:28:13  JCL      - ed102a5ef9d based on jdk-16+16)

23:21:18  --------------------------------------------------
23:21:18  TEST: java/util/logging/CheckZombieLockTest.java
23:21:18  TEST JDK: /home/jenkins/workspace/Test_openjdknext_j9_sanity.openjdk_ppc64_aix_Nightly/openjdkbinary/j2sdk-image
23:21:18  

23:21:18  STDERR:
23:21:18  WARNING: unable to delete/cleanup writable test directory: /tmp/writable-lockfile-dir
23:21:18  java.lang.RuntimeException: Unexpected lock files found: []
23:21:18  	/tmp/writable-lockfile-dir/log.log.lck should not have been reused
23:21:18  	at CheckZombieLockTest.testFileHandlerReuse(CheckZombieLockTest.java:257)
23:21:18  	at CheckZombieLockTest.runTests(CheckZombieLockTest.java:105)
23:21:18  	at CheckZombieLockTest.main(CheckZombieLockTest.java:78)
23:21:18  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
23:21:18  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
23:21:18  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
23:21:18  	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
23:21:18  	at com.sun.javatest.regtest.agent.MainWrapper$MainThread.run(MainWrapper.java:127)
23:21:18  	at java.base/java.lang.Thread.run(Thread.java:845)

JasonFengJ9 avatar Sep 23 '20 21:09 JasonFengJ9

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_ppc64_aix_Release/11

pshipton avatar Sep 28 '20 21:09 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_ppc64_aix_Nightly/186/

pshipton avatar Oct 21 '20 01:10 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk15_j9_sanity.openjdk_ppc64_aix_Nightly/157

pshipton avatar Jan 11 '21 14:01 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_xl_Nightly/46

pshipton avatar Jan 25 '21 18:01 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_ppc64_aix_mixed_Nightly/3/

pshipton avatar Jan 30 '21 13:01 pshipton

Also seen in an internal JDK11 AIX mixed build Test_openjdk11_j9_sanity.openjdk_ppc64_aix_mixed/1.

JasonFengJ9 avatar Feb 04 '21 13:02 JasonFengJ9

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_OpenJDK8/29

pshipton avatar Feb 04 '21 13:02 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_mixed_Nightly/8

pshipton avatar Feb 10 '21 13:02 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_mixed_Nightly/9

pshipton avatar Feb 11 '21 12:02 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk16_j9_sanity.openjdk_ppc64_aix_mixed_Nightly/6/

pshipton avatar Feb 16 '21 16:02 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_mixed_Nightly/15/ https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_ppc64_aix_mixed_Nightly/21/

pshipton avatar Feb 17 '21 13:02 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_mixed_Nightly/17/

pshipton avatar Feb 19 '21 16:02 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk16_j9_sanity.openjdk_x86-64_windows_mixed_Nightly/14

pshipton avatar Feb 23 '21 14:02 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_Nightly/299/

pshipton avatar Feb 26 '21 13:02 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_Nightly/300/ https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_ppc64_aix_Nightly/285/

pshipton avatar Mar 01 '21 14:03 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_Nightly/307/

pshipton avatar Mar 08 '21 13:03 pshipton

Do we know if this has failed with -XX:-GlobalLockReservation ?

tajila avatar Mar 09 '21 14:03 tajila

@tajila -XX:-GlobalLockReservation is still the default until https://github.com/eclipse/openj9/issues/11424 is merged, so yes it has.

pshipton avatar Mar 09 '21 14:03 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_Nightly/308

pshipton avatar Mar 09 '21 14:03 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk16_j9_sanity.openjdk_x86-64_windows_Nightly/32 https://ci.eclipse.org/openj9/job/Test_openjdk16_j9_sanity.openjdk_ppc64_aix_Nightly/32

pshipton avatar Mar 10 '21 03:03 pshipton

After taking a closer look at the issue, I believe it has nothing to do with globalLockReservation. Given the intermittent nature of the failure, it may be a file system issue.

tajila avatar Mar 10 '21 14:03 tajila

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_ppc64_aix_Nightly/293/

pshipton avatar Mar 11 '21 14:03 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk16_j9_sanity.openjdk_x86-64_windows_Nightly/35/

pshipton avatar Mar 13 '21 21:03 pshipton

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix_Nightly/318/

pshipton avatar Mar 19 '21 15:03 pshipton

https://ci.adoptopenjdk.net/job/Test_openjdk8_j9_sanity.openjdk_ppc64_aix/373/consoleFull

lumpfish avatar Apr 07 '21 14:04 lumpfish