openj9 icon indicating copy to clipboard operation
openj9 copied to clipboard

cmdLineTester_criu_nonPortableRestore_FAILED test time out

Open JasonFengJ9 opened this issue 2 years ago • 9 comments

Failure link

From an internal build(rhel7lert-1-9):

java version "17.0.8" 2023-07-18
IBM Semeru Runtime Certified Edition 17.0.8.0-rc1 (build 17.0.8+7)
Eclipse OpenJ9 VM 17.0.8.0-rc1 (build v0.40.0-release-b681a676a, JRE 17 Linux ppc64le-64-Bit Compressed References 20230718_452 (JIT enabled, AOT enabled)
OpenJ9   - b681a676a
OMR      - e80bff83b
JCL      - ca817eae983 based on jdk-17.0.8+7)

Rerun in Grinder - Change TARGET to run only the failed test targets.

Optional info

Failure output (captured from console output)

[2023-07-19T19:37:10.742Z] variation: -Xjit:count=0 -XX:+CRIURestoreNonPortableMode
[2023-07-19T19:37:10.742Z] JVM_OPTIONS:  -Xjit:count=0 -XX:+CRIURestoreNonPortableMode 

[2023-07-19T19:37:59.265Z] Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2023-07-19T19:37:59.265Z] Test start time: 2023/07/19 12:37:58 Pacific Standard Time
[2023-07-19T19:37:59.265Z] Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/openjdkbinary/j2sdk-image/bin/java " -Xjit:count=0 -XX:+CRIURestoreNonPortableMode " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false
[2023-07-19T19:37:59.265Z] Time spent starting: 3 milliseconds
[2023-07-19T19:43:05.473Z] ***[TEST INFO 2023/07/19 12:42:58] ProcessKiller detected a timeout after 300000 milliseconds!***
[2023-07-19T19:43:05.473Z] ***[TEST INFO 2023/07/19 12:42:59] executing /usr/bin/gdb -batch -x /tmp/debugger1074686980007286826.txt bash 23161***
[2023-07-19T19:43:05.473Z] GDB OUT 0x00003fff8bc2e488 in __waitpid_nocancel () from /lib64/libc.so.6
[2023-07-19T19:43:05.473Z] GDB OUT From                To                  Syms Read   Shared Object Library
[2023-07-19T19:43:05.473Z] GDB OUT 0x00003fff8bd7cb20  0x00003fff8bd8d73c  Yes (*)     /lib64/libtinfo.so.5
[2023-07-19T19:43:05.473Z] GDB OUT 0x00003fff8bd40dc0  0x00003fff8bd423ec  Yes (*)     /lib64/libdl.so.2
[2023-07-19T19:43:05.473Z] GDB OUT 0x00003fff8bb71d00  0x00003fff8bcd7870  Yes (*)     /lib64/libc.so.6
[2023-07-19T19:43:05.473Z] GDB OUT 0x00003fff8bdf0d60  0x00003fff8be178cc  Yes (*)     /lib64/ld64.so.2
[2023-07-19T19:43:05.473Z] GDB OUT (*): Shared library is missing debugging information.
[2023-07-19T19:43:05.473Z] GDB OUT r0             0x7	7
[2023-07-19T19:43:05.473Z] GDB OUT r1             0x3fffc1dfae00	70367701872128
[2023-07-19T19:43:05.473Z] GDB OUT r2             0x3fff8bd37400	70366795101184
[2023-07-19T19:43:05.473Z] GDB OUT r3             0x200	512
[2023-07-19T19:43:05.473Z] GDB OUT r4             0x3fffc1dfae70	70367701872240
[2023-07-19T19:43:05.473Z] GDB OUT r5             0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r6             0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r7             0x10030080340	1100317459264
[2023-07-19T19:43:05.473Z] GDB OUT r8             0x1003007c1b0	1100317442480
[2023-07-19T19:43:05.473Z] GDB OUT r9             0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r10            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r11            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r12            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r13            0x3fff8be3b330	70366796165936
[2023-07-19T19:43:05.473Z] GDB OUT r14            0x1013b38c	269726604
[2023-07-19T19:43:05.473Z] GDB OUT r15            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r16            0x1013b380	269726592
[2023-07-19T19:43:05.473Z] GDB OUT r17            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r18            0x10130d40	269684032
[2023-07-19T19:43:05.473Z] GDB OUT r19            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r20            0x4	4
[2023-07-19T19:43:05.473Z] GDB OUT r21            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r22            0x1	1
[2023-07-19T19:43:05.473Z] GDB OUT r23            0x2	2
[2023-07-19T19:43:05.473Z] GDB OUT r24            0xffffffffffffffff	18446744073709551615
[2023-07-19T19:43:05.473Z] GDB OUT r25            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r26            0xffff	65535
[2023-07-19T19:43:05.473Z] GDB OUT r27            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT r28            0x1013b38c	269726604
[2023-07-19T19:43:05.473Z] GDB OUT r29            0x10139fd0	269721552
[2023-07-19T19:43:05.473Z] GDB OUT r30            0x1003007c1b0	1100317442480
[2023-07-19T19:43:05.473Z] GDB OUT r31            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT pc             0x3fff8bc2e488	0x3fff8bc2e488 <__waitpid_nocancel+36>
[2023-07-19T19:43:05.473Z] GDB OUT msr            0x800000010000d033	9223372041149796403
[2023-07-19T19:43:05.473Z] GDB OUT cr             0x52042844	1376004164
[2023-07-19T19:43:05.473Z] GDB OUT lr             0x1004ffb4	0x1004ffb4 <waitchld.isra.10+292>
[2023-07-19T19:43:05.473Z] GDB OUT ctr            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT xer            0x0	0
[2023-07-19T19:43:05.473Z] GDB OUT orig_r3        0xffffffffffffffff	-1
[2023-07-19T19:43:05.473Z] GDB OUT trap           0xc00	3072
[2023-07-19T19:43:05.473Z] GDB OUT   Id   Target Id         Frame 
[2023-07-19T19:43:05.473Z] GDB OUT * 1    process 23161 "bash" 0x00003fff8bc2e488 in __waitpid_nocancel () from /lib64/libc.so.6
[2023-07-19T19:43:05.473Z] GDB OUT 
[2023-07-19T19:43:05.473Z] GDB OUT Thread 1 (process 23161):
[2023-07-19T19:43:05.473Z] GDB OUT #0  0x00003fff8bc2e488 in __waitpid_nocancel () from /lib64/libc.so.6
[2023-07-19T19:43:05.473Z] GDB OUT No symbol table info available.
[2023-07-19T19:43:05.473Z] GDB OUT #1  0x000000001004ffb4 in waitchld.isra.10 ()
[2023-07-19T19:43:05.473Z] GDB OUT No symbol table info available.
[2023-07-19T19:43:05.473Z] GDB OUT #2  0x000000001005190c in wait_for ()
[2023-07-19T19:43:05.473Z] GDB OUT No symbol table info available.
[2023-07-19T19:43:05.473Z] GDB OUT #3  0x000000001003c620 in execute_command_internal ()
[2023-07-19T19:43:05.473Z] GDB OUT No symbol table info available.
[2023-07-19T19:43:05.473Z] GDB OUT #4  0x000000001003c89c in execute_command ()
[2023-07-19T19:43:05.473Z] GDB OUT No symbol table info available.
[2023-07-19T19:43:05.473Z] GDB OUT #5  0x000000001001f97c in reader_loop ()
[2023-07-19T19:43:05.473Z] GDB OUT No symbol table info available.
[2023-07-19T19:43:05.473Z] GDB OUT #6  0x000000001001d49c in main ()
[2023-07-19T19:43:05.473Z] GDB OUT No symbol table info available.
[2023-07-19T19:43:05.473Z] GDB OUT Saved corefile core.23161.1
[2023-07-19T19:43:05.473Z] GDB OUT [Inferior 1 (process 23161) detached]
[2023-07-19T19:43:05.473Z] INFO: Sleep for 60000 millis before next capture.
[2023-07-19T19:44:08.191Z] ***[TEST INFO 2023/07/19 12:43:59] executing /usr/bin/gdb -batch -x /tmp/debugger1074686980007286826.txt bash 23161***
[2023-07-19T19:44:08.191Z] GDB OUT 0x00003fff8bc2e488 in __waitpid_nocancel () from /lib64/libc.so.6
[2023-07-19T19:44:08.191Z] GDB OUT From                To                  Syms Read   Shared Object Library
[2023-07-19T19:44:08.191Z] GDB OUT 0x00003fff8bd7cb20  0x00003fff8bd8d73c  Yes (*)     /lib64/libtinfo.so.5
[2023-07-19T19:44:08.191Z] GDB OUT 0x00003fff8bd40dc0  0x00003fff8bd423ec  Yes (*)     /lib64/libdl.so.2
[2023-07-19T19:44:08.191Z] GDB OUT 0x00003fff8bb71d00  0x00003fff8bcd7870  Yes (*)     /lib64/libc.so.6
[2023-07-19T19:44:08.191Z] GDB OUT 0x00003fff8bdf0d60  0x00003fff8be178cc  Yes (*)     /lib64/ld64.so.2
[2023-07-19T19:44:08.191Z] GDB OUT (*): Shared library is missing debugging information.
[2023-07-19T19:44:08.191Z] GDB OUT r0             0x7	7
[2023-07-19T19:44:08.191Z] GDB OUT r1             0x3fffc1dfae00	70367701872128
[2023-07-19T19:44:08.191Z] GDB OUT r2             0x3fff8bd37400	70366795101184
[2023-07-19T19:44:08.191Z] GDB OUT r3             0x200	512
[2023-07-19T19:44:08.191Z] GDB OUT r4             0x3fffc1dfae70	70367701872240
[2023-07-19T19:44:08.191Z] GDB OUT r5             0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r6             0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r7             0x10030080340	1100317459264
[2023-07-19T19:44:08.191Z] GDB OUT r8             0x1003007c1b0	1100317442480
[2023-07-19T19:44:08.191Z] GDB OUT r9             0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r10            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r11            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r12            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r13            0x3fff8be3b330	70366796165936
[2023-07-19T19:44:08.191Z] GDB OUT r14            0x1013b38c	269726604
[2023-07-19T19:44:08.191Z] GDB OUT r15            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r16            0x1013b380	269726592
[2023-07-19T19:44:08.191Z] GDB OUT r17            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r18            0x10130d40	269684032
[2023-07-19T19:44:08.191Z] GDB OUT r19            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r20            0x4	4
[2023-07-19T19:44:08.191Z] GDB OUT r21            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r22            0x1	1
[2023-07-19T19:44:08.191Z] GDB OUT r23            0x2	2
[2023-07-19T19:44:08.191Z] GDB OUT r24            0xffffffffffffffff	18446744073709551615
[2023-07-19T19:44:08.191Z] GDB OUT r25            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r26            0xffff	65535
[2023-07-19T19:44:08.191Z] GDB OUT r27            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT r28            0x1013b38c	269726604
[2023-07-19T19:44:08.191Z] GDB OUT r29            0x10139fd0	269721552
[2023-07-19T19:44:08.191Z] GDB OUT r30            0x1003007c1b0	1100317442480
[2023-07-19T19:44:08.191Z] GDB OUT r31            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT pc             0x3fff8bc2e488	0x3fff8bc2e488 <__waitpid_nocancel+36>
[2023-07-19T19:44:08.191Z] GDB OUT msr            0x800000010000d033	9223372041149796403
[2023-07-19T19:44:08.191Z] GDB OUT cr             0x52042844	1376004164
[2023-07-19T19:44:08.191Z] GDB OUT lr             0x1004ffb4	0x1004ffb4 <waitchld.isra.10+292>
[2023-07-19T19:44:08.191Z] GDB OUT ctr            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT xer            0x0	0
[2023-07-19T19:44:08.191Z] GDB OUT orig_r3        0xffffffffffffffff	-1
[2023-07-19T19:44:08.191Z] GDB OUT trap           0xc00	3072
[2023-07-19T19:44:08.191Z] GDB OUT   Id   Target Id         Frame 
[2023-07-19T19:44:08.191Z] GDB OUT * 1    process 23161 "bash" 0x00003fff8bc2e488 in __waitpid_nocancel () from /lib64/libc.so.6
[2023-07-19T19:44:08.191Z] GDB OUT 
[2023-07-19T19:44:08.191Z] GDB OUT Thread 1 (process 23161):
[2023-07-19T19:44:08.191Z] GDB OUT #0  0x00003fff8bc2e488 in __waitpid_nocancel () from /lib64/libc.so.6
[2023-07-19T19:44:08.191Z] GDB OUT No symbol table info available.
[2023-07-19T19:44:08.191Z] GDB OUT #1  0x000000001004ffb4 in waitchld.isra.10 ()
[2023-07-19T19:44:08.191Z] GDB OUT No symbol table info available.
[2023-07-19T19:44:08.191Z] GDB OUT #2  0x000000001005190c in wait_for ()
[2023-07-19T19:44:08.191Z] GDB OUT No symbol table info available.
[2023-07-19T19:44:08.191Z] GDB OUT #3  0x000000001003c620 in execute_command_internal ()
[2023-07-19T19:44:08.191Z] GDB OUT No symbol table info available.
[2023-07-19T19:44:08.191Z] GDB OUT #4  0x000000001003c89c in execute_command ()
[2023-07-19T19:44:08.191Z] GDB OUT No symbol table info available.
[2023-07-19T19:44:08.191Z] GDB OUT #5  0x000000001001f97c in reader_loop ()
[2023-07-19T19:44:08.191Z] GDB OUT No symbol table info available.
[2023-07-19T19:44:08.191Z] GDB OUT #6  0x000000001001d49c in main ()
[2023-07-19T19:44:08.191Z] GDB OUT No symbol table info available.
[2023-07-19T19:44:08.191Z] GDB OUT Saved corefile core.23161.2
[2023-07-19T19:44:08.191Z] GDB OUT A debugging session is active.
[2023-07-19T19:44:08.191Z] GDB OUT 
[2023-07-19T19:44:08.191Z] GDB OUT 	Inferior 1 [process 23161] will be detached.
[2023-07-19T19:44:08.191Z] GDB OUT 
[2023-07-19T19:44:08.191Z] GDB OUT Quit anyway? (y or n) [answered Y; input not from terminal]
[2023-07-19T19:44:08.191Z] GDB OUT [Inferior 1 (process 23161) detached]
[2023-07-19T19:44:08.191Z] ***[TEST INFO 2023/07/19 12:43:59] executing kill -ABRT 23161***
[2023-07-19T19:44:08.191Z] ***[TEST INFO 2023/07/19 12:43:59] kill -ABRT signal sent***
[2023-07-19T19:44:08.191Z] Time spent executing: 360908 milliseconds
[2023-07-19T19:44:08.191Z] Test result: FAILED
[2023-07-19T19:44:08.191Z] Output from test:
[2023-07-19T19:44:08.191Z]  [OUT] start running script
[2023-07-19T19:44:08.191Z]  [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
[2023-07-19T19:44:08.191Z]  [OUT] export LD_BIND_NOT=on
[2023-07-19T19:44:08.192Z]  [OUT] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/openjdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -Xjit:count=0 -XX:+CRIURestoreNonPortableMode  -cp /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3

[2023-07-19T19:44:08.192Z] Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2023-07-19T19:44:08.192Z] Test start time: 2023/07/19 12:43:59 Pacific Standard Time
[2023-07-19T19:44:08.192Z] Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/openjdkbinary/j2sdk-image/bin/java " -Xjit:count=0 -XX:+CRIURestoreNonPortableMode " "org.openj9.criu.TimeChangeTest testMillisDelayAfterCheckpointDone" 3 3 false
[2023-07-19T19:44:08.192Z] Time spent starting: 9 milliseconds
[2023-07-19T19:44:08.192Z] ***[TEST INFO 2023/07/19 12:43:59] ABRT completed***
[2023-07-19T19:44:08.192Z] Output from test:
[2023-07-19T19:49:13.729Z] ***[TEST INFO 2023/07/19 12:48:59] ProcessKiller detected a timeout after 300000 milliseconds!***

[2023-07-19T19:50:08.993Z] Testing: Create CRIU checkpoint image and restore three times - testDateScheduledBeforeCheckpointDone
[2023-07-19T19:50:08.993Z] Test start time: 2023/07/19 12:50:00 Pacific Standard Time
[2023-07-19T19:50:08.993Z] Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/openjdkbinary/j2sdk-image/bin/java " -Xjit:count=0 -XX:+CRIURestoreNonPortableMode " "org.openj9.criu.TimeChangeTest testDateScheduledBeforeCheckpointDone" 3 3 false
[2023-07-19T19:50:08.993Z] Time spent starting: 4 milliseconds
[2023-07-19T19:50:08.993Z] ***[TEST INFO 2023/07/19 12:50:00] ABRT completed***
[2023-07-19T19:50:08.993Z] Output from test:
[2023-07-19T19:55:04.522Z] ***[TEST INFO 2023/07/19 12:55:00] ProcessKiller detected a timeout after 300000 milliseconds!***

[2023-07-19T19:56:05.036Z] Testing: Create CRIU checkpoint image and restore three times - testDateScheduledAfterCheckpointDone
[2023-07-19T19:56:05.036Z] Test start time: 2023/07/19 12:56:00 Pacific Standard Time
[2023-07-19T19:56:05.036Z] Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_0/openjdkbinary/j2sdk-image/bin/java " -Xjit:count=0 -XX:+CRIURestoreNonPortableMode " "org.openj9.criu.TimeChangeTest testDateScheduledAfterCheckpointDone" 3 3 false
[2023-07-19T19:56:05.036Z] Time spent starting: 4 milliseconds
[2023-07-19T19:56:05.036Z] ***[TEST INFO 2023/07/19 12:56:00] ABRT completed***
[2023-07-19T19:56:05.036Z] Output from test:
[2023-07-19T20:01:07.391Z] ***[TEST INFO 2023/07/19 13:01:00] ProcessKiller detected a timeout after 300000 milliseconds!***

[2023-07-19T20:05:42.386Z] cmdLineTester_criu_nonPortableRestore_2_FAILED

50x internal grinder - reproduced at prhel248, 20/20 passed in other 2 machines, 20/20 known failure in another 2 machines.

This timeout might be related to the machine setup issue org.eclipse.openj9.criu.SystemCheckpointException: Could not dump the JVM processes, err=-52.

JasonFengJ9 avatar Jul 21 '23 17:07 JasonFengJ9

JDK17 ppc64le_linux

[2023-08-24T21:14:14.011Z] variation: -Xgcpolicy:optthruput
[2023-08-24T21:14:14.011Z] JVM_OPTIONS:  -Xgcpolicy:optthruput 

[2023-08-24T21:15:02.090Z] Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2023-08-24T21:15:02.090Z] Test start time: 2023/08/24 14:15:01 Pacific Standard Time
[2023-08-24T21:15:02.090Z] Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_2/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_2/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_2/openjdkbinary/j2sdk-image/bin/java " -Xgcpolicy:optthruput " "org.openj9.criu.TimeChangeTest testMillisDelayAfterCheckpointDone" 3 3 false
[2023-08-24T21:15:02.090Z] Time spent starting: 7 milliseconds
[2023-08-24T21:20:09.194Z] ***[TEST INFO 2023/08/24 14:20:01] ProcessKiller detected a timeout after 300000 milliseconds!***
[2023-08-24T21:20:09.194Z] INFO: Cannot find '/usr/bin/gdb' using 'gdb' from the path.
[2023-08-24T21:20:09.194Z] ***[TEST INFO 2023/08/24 14:20:01] executing gdb -batch -x /tmp/debugger18282568250225923466.txt bash 32048***
[2023-08-24T21:20:09.194Z] java.io.IOException: Cannot run program "gdb": error=2, No such file or directory
[2023-08-24T21:20:09.194Z] 	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1143)
[2023-08-24T21:20:09.194Z] 	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1073)
[2023-08-24T21:20:09.194Z] 	at java.base/java.lang.Runtime.exec(Runtime.java:594)
[2023-08-24T21:20:09.194Z] 	at java.base/java.lang.Runtime.exec(Runtime.java:453)
[2023-08-24T21:20:09.194Z] 	at Test$ProcessKiller.captureCoreForProcess(Test.java:697)
[2023-08-24T21:20:09.194Z] 	at Test$ProcessKiller.captureCoreForProcess(Test.java:646)
[2023-08-24T21:20:09.194Z] 	at Test$ProcessKiller.run(Test.java:596)
[2023-08-24T21:20:09.194Z] Caused by: java.io.IOException: error=2, No such file or directory
[2023-08-24T21:20:09.194Z] 	at java.base/java.lang.ProcessImpl.<init>(ProcessImpl.java:314)
[2023-08-24T21:20:09.194Z] 	at java.base/java.lang.ProcessImpl.start(ProcessImpl.java:244)
[2023-08-24T21:20:09.194Z] 	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1110)
[2023-08-24T21:20:09.194Z] 	... 6 more
[2023-08-24T21:20:09.194Z] ***[TEST INFO 2023/08/24 14:20:01] executing kill -ABRT 32048***
[2023-08-24T21:20:09.194Z] ***[TEST INFO 2023/08/24 14:20:01] kill -ABRT signal sent***
[2023-08-24T21:20:09.194Z] ***[TEST INFO 2023/08/24 14:20:01] ABRT completed***
[2023-08-24T21:20:09.194Z] Output from test:
[2023-08-24T21:20:09.194Z]  [OUT] start running script
[2023-08-24T21:20:09.194Z]  [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
[2023-08-24T21:20:09.194Z]  [OUT] export LD_BIND_NOT=on
[2023-08-24T21:20:09.194Z]  [OUT] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_2/openjdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -Xgcpolicy:optthruput  -cp /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_2/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayAfterCheckpointDone 3 3
[2023-08-24T21:20:09.194Z]  [ERR] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_2/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 40: 32052 Killed                  $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1
[2023-08-24T21:20:09.194Z]  [ERR]  32052: Error (criu/files-reg.c:2094): File home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_2/aqa-tests/TKG/output_16929111826194/cmdLineTester_criu_nonPortableRestore_3/testOutput has bad size 809 (expect 371)
[2023-08-24T21:20:09.194Z]  [ERR]  32052: Error (criu/files.c:1213): Unable to open fd=1 id=0x39
[2023-08-24T21:20:09.194Z]  [ERR] Error (criu/cr-restore.c:2536): Restoring FAILED.
[2023-08-24T21:20:09.194Z]  [ERR] Error (criu/cr-restore.c:1498): 32052 killed by signal 9: Killed
[2023-08-24T21:20:09.194Z]  [ERR]  32052: Error (criu/files-reg.c:2094): File home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_ppc64le_linux_testList_2/aqa-tests/TKG/output_16929111826194/cmdLineTester_criu_nonPortableRestore_3/testOutput has bad size 809 (expect 371)
[2023-08-24T21:20:09.194Z]  [ERR]  32052: Error (criu/files.c:1213): Unable to open fd=1 id=0x39
[2023-08-24T21:20:09.194Z]  [ERR] Error (criu/cr-restore.c:2536): Restoring FAILED.
[2023-08-24T21:36:39.760Z] ***[TEST INFO 2023/08/24 14:36:31] stdout timed out***
[2023-08-24T21:36:39.760Z] ***[TEST INFO 2023/08/24 14:36:31] stderr timed out***
[2023-08-24T21:36:39.760Z] Time spent executing: 1290011 milliseconds
[2023-08-24T21:36:39.760Z] Test result: FAILED
[2023-08-24T21:36:39.760Z] Output from test:

[2023-08-24T21:39:29.467Z] ---TEST RESULTS---
[2023-08-24T21:39:29.467Z] Number of PASSED tests: 42 out of 43
[2023-08-24T21:39:29.467Z] Number of FAILED tests: 1 out of 43
[2023-08-24T21:39:29.467Z] 
[2023-08-24T21:39:29.467Z] ---SUMMARY OF FAILED TESTS---
[2023-08-24T21:39:29.467Z] Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2023-08-24T21:39:29.467Z] -----------------------------
[2023-08-24T21:39:29.467Z] 
[2023-08-24T21:39:29.467Z] -----------------------------------
[2023-08-24T21:39:29.467Z] cmdLineTester_criu_nonPortableRestore_3_FAILED

50x grinder - 10/50 failed, only at ubu20le-rt1-8

JasonFengJ9 avatar Aug 29 '23 19:08 JasonFengJ9

JDK11 s390x_linux(rhel8s390x-svl-rt6-1)

openjdk version "11.0.22" 2024-01-16
IBM Semeru Runtime Open Edition 11.0.22.0-m1 (build 11.0.22+5)
Eclipse OpenJ9 VM 11.0.22.0-m1 (build v0.43.0-release-579b3f8e0, JRE 11 Linux s390x-64-Bit Compressed References 20231204_797 (JIT enabled, AOT enabled)
OpenJ9   - 579b3f8e0
OMR      - d810fcb98
JCL      - 91ab4bbfc4 based on jdk-11.0.22+5)

[2023-12-04T20:54:18.500Z] variation: -Xjit -XX:+CRIURestoreNonPortableMode
[2023-12-04T20:54:18.500Z] JVM_OPTIONS:  -Xjit -XX:+CRIURestoreNonPortableMode 

[2023-12-04T20:54:38.371Z] Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2023-12-04T20:54:38.371Z] Test start time: 2023/12/04 12:54:37 Pacific Standard Time
[2023-12-04T20:54:38.371Z] Running command: bash /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_rerun/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_rerun/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_rerun/jdkbinary/j2sdk-image/bin/java " -Xjit -XX:+CRIURestoreNonPortableMode " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
[2023-12-04T20:54:38.371Z] Time spent starting: 1 milliseconds
[2023-12-04T20:59:51.957Z] ***[TEST INFO 2023/12/04 12:59:37] ProcessKiller detected a timeout after 300000 milliseconds!***
[2023-12-04T20:59:51.957Z] INFO: Cannot find '/usr/bin/gdb' using 'gdb' from the path.
[2023-12-04T20:59:51.957Z] ***[TEST INFO 2023/12/04 12:59:37] executing gdb -batch -x /tmp/debugger14423167674456250795.txt bash 79801***
[2023-12-04T20:59:51.957Z] java.io.IOException: Cannot run program "gdb": error=2, No such file or directory
[2023-12-04T20:59:51.957Z] 	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1128)
[2023-12-04T20:59:51.957Z] 	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1071)
[2023-12-04T20:59:51.957Z] 	at java.base/java.lang.Runtime.exec(Runtime.java:592)
[2023-12-04T20:59:51.957Z] 	at java.base/java.lang.Runtime.exec(Runtime.java:451)
[2023-12-04T20:59:51.957Z] 	at Test$ProcessKiller.captureCoreForProcess(Test.java:697)
[2023-12-04T20:59:51.957Z] 	at Test$ProcessKiller.captureCoreForProcess(Test.java:646)
[2023-12-04T20:59:51.957Z] 	at Test$ProcessKiller.run(Test.java:596)
[2023-12-04T20:59:51.957Z] Caused by: java.io.IOException: error=2, No such file or directory
[2023-12-04T20:59:51.957Z] 	at java.base/java.lang.ProcessImpl.<init>(ProcessImpl.java:340)
[2023-12-04T20:59:51.957Z] 	at java.base/java.lang.ProcessImpl.start(ProcessImpl.java:271)
[2023-12-04T20:59:51.957Z] 	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1107)
[2023-12-04T20:59:51.957Z] 	... 6 more
[2023-12-04T20:59:51.957Z] ***[TEST INFO 2023/12/04 12:59:37] executing kill -ABRT 79801***
[2023-12-04T20:59:51.957Z] Time spent executing: 300045 milliseconds
[2023-12-04T20:59:51.957Z] Test result: FAILED
[2023-12-04T20:59:51.957Z] Output from test:
[2023-12-04T20:59:51.957Z]  [OUT] start running script
[2023-12-04T20:59:51.957Z]  [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
[2023-12-04T20:59:51.957Z]  [OUT] export LD_BIND_NOT=on
[2023-12-04T20:59:51.957Z]  [OUT] /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_rerun/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -Xjit -XX:+CRIURestoreNonPortableMode  -cp /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_rerun/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3
[2023-12-04T20:59:51.957Z]  [ERR] /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_rerun/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41: 79805 Killed                  $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1
[2023-12-04T20:59:51.957Z] 
[2023-12-04T20:59:51.957Z] ***[TEST INFO 2023/12/04 12:59:37] kill -ABRT signal sent***
[2023-12-04T20:59:51.957Z] ***[TEST INFO 2023/12/04 12:59:37] ABRT completed***

[2023-12-04T21:02:31.532Z] ---TEST RESULTS---
[2023-12-04T21:02:31.532Z] Number of PASSED tests: 55 out of 56
[2023-12-04T21:02:31.532Z] Number of FAILED tests: 1 out of 56
[2023-12-04T21:02:31.532Z] 
[2023-12-04T21:02:31.532Z] ---SUMMARY OF FAILED TESTS---
[2023-12-04T21:02:31.532Z] Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2023-12-04T21:02:31.532Z] -----------------------------
[2023-12-04T21:02:31.532Z] 
[2023-12-04T21:02:31.532Z] -----------------------------------
[2023-12-04T21:02:31.532Z] cmdLineTester_criu_nonPortableRestore_0_FAILED

50x grinder - passed at ubu22s390x-rt-2, ubu22s390x-svl-rt7-1 & ubu22s390x-svl-rt8-1, failed at sles12s390x-svl-rt6-1 & sles12s390x-svl-rt4-1.

JasonFengJ9 avatar Dec 07 '23 17:12 JasonFengJ9

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/78/ cmdLineTester_criu_nonPortableRestore_6

Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
Test start time: 2023/12/11 06:18:39 Coordinated Universal Time
Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:optavgpause " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
Time spent starting: 4 milliseconds
***[TEST INFO 2023/12/11 06:23:39] ProcessKiller detected a timeout after 300000 milliseconds!***
***[TEST INFO 2023/12/11 06:23:40] executing /usr/bin/gdb -batch -x /tmp/debugger2654258373181966373.txt bash 29959***
GDB OUT No shared libraries loaded at this time.
INFO: Running '/usr/bin/gdb' failed with rc = 1
GDB ERR Could not attach to process.  If your uid matches the uid of the target
GDB ERR process, check the setting of /proc/sys/kernel/yama/ptrace_scope, or try
GDB ERR again as the root user.  For more details, see /etc/sysctl.d/10-ptrace.conf
GDB ERR ptrace: Operation not permitted.
GDB ERR /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/aqa-tests/TKG/output_17022720144281/cmdLineTester_criu_nonPortableRestore_6/29959: No such file or directory.
GDB ERR /tmp/debugger2654258373181966373.txt:2: Error in sourced command file:
GDB ERR The program has no registers now.

INFO: Sleep for 60000 millis before next capture.
***[TEST INFO 2023/12/11 06:24:40] executing /usr/bin/gdb -batch -x /tmp/debugger2654258373181966373.txt bash 29959***
GDB OUT No shared libraries loaded at this time.
INFO: Running '/usr/bin/gdb' failed with rc = 1
GDB ERR Could not attach to process.  If your uid matches the uid of the target
GDB ERR process, check the setting of /proc/sys/kernel/yama/ptrace_scope, or try
GDB ERR again as the root user.  For more details, see /etc/sysctl.d/10-ptrace.conf
GDB ERR ptrace: Operation not permitted.
GDB ERR /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/aqa-tests/TKG/output_17022720144281/cmdLineTester_criu_nonPortableRestore_6/29959: No such file or directory.
GDB ERR /tmp/debugger2654258373181966373.txt:2: Error in sourced command file:
GDB ERR The program has no registers now.

***[TEST INFO 2023/12/11 06:24:40] executing kill -ABRT 29959***
Time spent executing: 361169 milliseconds
Test result: FAILED
Output from test:
 [OUT] start running script
 [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
 [OUT] export LD_BIND_NOT=on
 [OUT] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -Xgcpolicy:optavgpause  -cp /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3
***[TEST INFO 2023/12/11 06:24:40] kill -ABRT signal sent***
 [ERR] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Release_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41: 29962 Killed                  $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1

***[TEST INFO 2023/12/11 06:24:40] ABRT completed***
Output from test:

pshipton avatar Dec 11 '23 22:12 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/589 cmdLineTester_criu_nonPortableRestore_7

Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
Test start time: 2023/12/15 21:35:50 Eastern Standard Time
Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1 " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
Time spent starting: 5 milliseconds
***[TEST INFO 2023/12/15 21:40:50] ProcessKiller detected a timeout after 300000 milliseconds!***
***[TEST INFO 2023/12/15 21:40:51] executing /usr/bin/gdb -batch -x /tmp/debugger2654258373181966373.txt bash 4023169***
GDB OUT 0x0000ffff9b5b3908 in waitpid () from /lib64/libc.so.6
GDB OUT From                To                  Syms Read   Shared Object Library
GDB OUT 0x0000ffff9b6ce010  0x0000ffff9b6daad4  Yes (*)     /lib64/libtinfo.so.6
GDB OUT 0x0000ffff9b690f50  0x0000ffff9b691d74  Yes (*)     /lib64/libdl.so.2
GDB OUT 0x0000ffff9b5307c0  0x0000ffff9b620a18  Yes (*)     /lib64/libc.so.6
GDB OUT 0x0000ffff9b750f80  0x0000ffff9b76aa18  Yes (*)     /lib/ld-linux-aarch64.so.1
GDB OUT (*): Shared library is missing debugging information.
GDB OUT x0             0xffffffffffffffff  -1
GDB OUT x1             0xfffff0145cc0      281474709609664
GDB OUT x2             0x0                 0
GDB OUT x3             0x0                 0
GDB OUT x4             0x1                 1
GDB OUT x5             0xaaaad5233c50      187650697018448
GDB OUT x6             0x3d63e6            4023270
GDB OUT x7             0x0                 0
GDB OUT x8             0x104               260
GDB OUT x9             0xaaaad5239c50      187650697043024
GDB OUT x10            0xffff9b78f650      281473290139216
GDB OUT x11            0xaaaab3149a48      187650125634120
GDB OUT x12            0x0                 0
GDB OUT x13            0xaaaab306e228      187650124735016
GDB OUT x14            0x8                 8
GDB OUT x15            0x48                72
GDB OUT x16            0xaaaab313ee68      187650125590120
GDB OUT x17            0xffff9b5b38d8      281473288190168
GDB OUT x18            0x0                 0
GDB OUT x19            0xffffffffffffffff  -1
GDB OUT x20            0xaaaab3140000      187650125594624
GDB OUT x21            0xaaaab313f000      187650125590528
GDB OUT x22            0xaaaab313f000      187650125590528
GDB OUT x23            0x0                 0
GDB OUT x24            0x1                 1
GDB OUT x25            0xaaaab313f000      187650125590528
GDB OUT x26            0xaaaab31406c0      187650125596352
GDB OUT x27            0xaaaab314ce88      187650125647496
GDB OUT x28            0x0                 0
GDB OUT x29            0xfffff0145c00      281474709609472
GDB OUT x30            0xaaaab306ae80      187650124721792
GDB OUT sp             0xfffff0145c00      0xfffff0145c00
GDB OUT pc             0xffff9b5b3908      0xffff9b5b3908 <waitpid+48>
GDB OUT cpsr           0x60001000          [ EL=0 C Z ]
GDB OUT fpsr           0x0                 0
GDB OUT fpcr           0x0                 0
GDB OUT   Id   Target Id              Frame 
GDB OUT * 1    process 4023169 "bash" 0x0000ffff9b5b3908 in waitpid () from /lib64/libc.so.6
GDB OUT 
GDB OUT Thread 1 (process 4023169):
GDB OUT #0  0x0000ffff9b5b3908 in waitpid () from /lib64/libc.so.6
GDB OUT No symbol table info available.
GDB OUT #1  0x0000aaaab306ae80 in waitchld.isra ()
GDB OUT No symbol table info available.
GDB OUT #2  0x0000aaaab306c5ac in wait_for ()
GDB OUT No symbol table info available.
GDB OUT #3  0x0000aaaab305ab2c in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #4  0x0000aaaab3059c9c in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #5  0x0000aaaab305adb8 in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #6  0x0000aaaab3058e30 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #7  0x0000aaaab3059c9c in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #8  0x0000aaaab305adb8 in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #9  0x0000aaaab3058688 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #10 0x0000aaaab305adb8 in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #11 0x0000aaaab30428bc in reader_loop ()
GDB OUT No symbol table info available.
GDB OUT #12 0x0000aaaab3040e40 in main ()
GDB OUT No symbol table info available.
GDB OUT Saved corefile core.4023169.1
GDB OUT [Inferior 1 (process 4023169) detached]
INFO: Running '/usr/bin/gdb' failed with rc = 1
GDB ERR warning: target file /proc/4023169/cmdline contained unexpected null characters
GDB ERR warning: Memory read failed for corefile section, 131072 bytes at 0xffff9b720000.
GDB ERR /tmp/debugger2654258373181966373.txt:6: Error in sourced command file:
GDB ERR Requires argument (inferior id(s) to detach)

INFO: Sleep for 60000 millis before next capture.
***[TEST INFO 2023/12/15 21:41:51] executing /usr/bin/gdb -batch -x /tmp/debugger2654258373181966373.txt bash 4023169***
GDB OUT 0x0000ffff9b5b3908 in waitpid () from /lib64/libc.so.6
GDB OUT From                To                  Syms Read   Shared Object Library
GDB OUT 0x0000ffff9b6ce010  0x0000ffff9b6daad4  Yes (*)     /lib64/libtinfo.so.6
GDB OUT 0x0000ffff9b690f50  0x0000ffff9b691d74  Yes (*)     /lib64/libdl.so.2
GDB OUT 0x0000ffff9b5307c0  0x0000ffff9b620a18  Yes (*)     /lib64/libc.so.6
GDB OUT 0x0000ffff9b750f80  0x0000ffff9b76aa18  Yes (*)     /lib/ld-linux-aarch64.so.1
GDB OUT (*): Shared library is missing debugging information.
GDB OUT x0             0xffffffffffffffff  -1
GDB OUT x1             0xfffff0145cc0      281474709609664
GDB OUT x2             0x0                 0
GDB OUT x3             0x0                 0
GDB OUT x4             0x1                 1
GDB OUT x5             0xaaaad5233c50      187650697018448
GDB OUT x6             0x3d63e6            4023270
GDB OUT x7             0x0                 0
GDB OUT x8             0x104               260
GDB OUT x9             0xaaaad5239c50      187650697043024
GDB OUT x10            0xffff9b78f650      281473290139216
GDB OUT x11            0xaaaab3149a48      187650125634120
GDB OUT x12            0x0                 0
GDB OUT x13            0xaaaab306e228      187650124735016
GDB OUT x14            0x8                 8
GDB OUT x15            0x48                72
GDB OUT x16            0xaaaab313ee68      187650125590120
GDB OUT x17            0xffff9b5b38d8      281473288190168
GDB OUT x18            0x0                 0
GDB OUT x19            0xffffffffffffffff  -1
GDB OUT x20            0xaaaab3140000      187650125594624
GDB OUT x21            0xaaaab313f000      187650125590528
GDB OUT x22            0xaaaab313f000      187650125590528
GDB OUT x23            0x0                 0
GDB OUT x24            0x1                 1
GDB OUT x25            0xaaaab313f000      187650125590528
GDB OUT x26            0xaaaab31406c0      187650125596352
GDB OUT x27            0xaaaab314ce88      187650125647496
GDB OUT x28            0x0                 0
GDB OUT x29            0xfffff0145c00      281474709609472
GDB OUT x30            0xaaaab306ae80      187650124721792
GDB OUT sp             0xfffff0145c00      0xfffff0145c00
GDB OUT pc             0xffff9b5b3908      0xffff9b5b3908 <waitpid+48>
GDB OUT cpsr           0x60001000          [ EL=0 C Z ]
GDB OUT fpsr           0x0                 0
GDB OUT fpcr           0x0                 0
GDB OUT   Id   Target Id              Frame 
GDB OUT * 1    process 4023169 "bash" 0x0000ffff9b5b3908 in waitpid () from /lib64/libc.so.6
GDB OUT 
GDB OUT Thread 1 (process 4023169):
GDB OUT #0  0x0000ffff9b5b3908 in waitpid () from /lib64/libc.so.6
GDB OUT No symbol table info available.
GDB OUT #1  0x0000aaaab306ae80 in waitchld.isra ()
GDB OUT No symbol table info available.
GDB OUT #2  0x0000aaaab306c5ac in wait_for ()
GDB OUT No symbol table info available.
GDB OUT #3  0x0000aaaab305ab2c in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #4  0x0000aaaab3059c9c in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #5  0x0000aaaab305adb8 in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #6  0x0000aaaab3058e30 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #7  0x0000aaaab3059c9c in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #8  0x0000aaaab305adb8 in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #9  0x0000aaaab3058688 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #10 0x0000aaaab305adb8 in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #11 0x0000aaaab30428bc in reader_loop ()
GDB OUT No symbol table info available.
GDB OUT #12 0x0000aaaab3040e40 in main ()
GDB OUT No symbol table info available.
GDB OUT Saved corefile core.4023169.2
GDB OUT A debugging session is active.
GDB OUT 
GDB OUT 	Inferior 1 [process 4023169] will be detached.
GDB OUT 
GDB OUT Quit anyway? (y or n) [answered Y; input not from terminal]
GDB OUT [Inferior 1 (process 4023169) detached]
***[TEST INFO 2023/12/15 21:41:51] executing kill -ABRT 4023169***
***[TEST INFO 2023/12/15 21:41:51] kill -ABRT signal sent***
Time spent executing: 360869 milliseconds
Test result: FAILED
Output from test:
***[TEST INFO 2023/12/15 21:41:51] ABRT completed***
 [OUT] start running script
 [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
 [OUT] export LD_BIND_NOT=on
 [OUT] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1  -cp /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3
 [ERR] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41: 4023170 Killed                  $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1
Output from test:

pshipton avatar Dec 17 '23 15:12 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.functional_x86-64_linux_Nightly_testList_1/70 cmdLineTester_criu_nonPortableRestore_5 Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone

pshipton avatar Dec 19 '23 22:12 pshipton

JDK21 s390x_linux_fips140_2(rhel8s390x-svl-rtfips7-1)

[2024-01-09T23:08:19.816Z] variation: -Xgcpolicy:optthruput
[2024-01-09T23:08:19.816Z] JVM_OPTIONS:  -Xgcpolicy:optthruput  -Dsemeru.fips=true

[2024-01-09T23:08:49.493Z] Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2024-01-09T23:08:49.493Z] Test start time: 2024/01/09 15:08:49 Pacific Standard Time
[2024-01-09T23:08:49.493Z] Running command: bash /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_s390x_linux_fips140_2_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_s390x_linux_fips140_2_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_s390x_linux_fips140_2_testList_0/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:optthruput  -Dsemeru.fips=true" "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
[2024-01-09T23:08:49.493Z] Time spent starting: 19 milliseconds
[2024-01-09T23:13:57.889Z] ***[TEST INFO 2024/01/09 15:13:49] ProcessKiller detected a timeout after 300000 milliseconds!***

[2024-01-09T23:18:37.071Z] ---TEST RESULTS---
[2024-01-09T23:18:37.071Z] Number of PASSED tests: 55 out of 56
[2024-01-09T23:18:37.071Z] Number of FAILED tests: 1 out of 56
[2024-01-09T23:18:37.071Z] 
[2024-01-09T23:18:37.071Z] ---SUMMARY OF FAILED TESTS---
[2024-01-09T23:18:37.071Z] Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2024-01-09T23:18:37.071Z] -----------------------------
[2024-01-09T23:18:37.071Z] 
[2024-01-09T23:18:37.071Z] -----------------------------------
[2024-01-09T23:18:37.071Z] cmdLineTester_criu_nonPortableRestore_5_FAILED

JasonFengJ9 avatar Jan 10 '24 21:01 JasonFengJ9

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/624 cmdLineTester_criu_nonPortableRestore_7

20:02:22  Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
20:02:22  Test start time: 2024/02/07 20:02:22 Eastern Standard Time
20:02:22  Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1 " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
20:02:22  Time spent starting: 2 milliseconds
20:07:37  ***[TEST INFO 2024/02/07 20:07:22] ProcessKiller detected a timeout after 300000 milliseconds!***
20:07:37  ***[TEST INFO 2024/02/07 20:07:22] executing /usr/bin/gdb -batch -x /tmp/debugger2101984825186466203.txt bash 1426201***
20:07:37  GDB OUT 0x0000ffff928f3908 in waitpid () from /lib64/libc.so.6
20:07:37  GDB OUT From                To                  Syms Read   Shared Object Library
20:07:37  GDB OUT 0x0000ffff92a0e010  0x0000ffff92a1aad4  Yes (*)     /lib64/libtinfo.so.6
20:07:37  GDB OUT 0x0000ffff929d0f50  0x0000ffff929d1d74  Yes (*)     /lib64/libdl.so.2
20:07:37  GDB OUT 0x0000ffff928707c0  0x0000ffff92960a18  Yes (*)     /lib64/libc.so.6
20:07:37  GDB OUT 0x0000ffff92a90f80  0x0000ffff92aaaa18  Yes (*)     /lib/ld-linux-aarch64.so.1
20:07:37  GDB OUT (*): Shared library is missing debugging information.
20:07:37  GDB OUT x0             0xffffffffffffffff  -1
20:07:37  GDB OUT x1             0xffffd0b43820      281474183215136
20:07:37  GDB OUT x2             0x0                 0
20:07:37  GDB OUT x3             0x0                 0
20:07:37  GDB OUT x4             0x1                 1
20:07:37  GDB OUT x5             0xaaab13163c50      187651736353872
20:07:37  GDB OUT x6             0x15c381            1426305
20:07:37  GDB OUT x7             0x0                 0
20:07:37  GDB OUT x8             0x104               260
20:07:37  GDB OUT x9             0xaaab13169c50      187651736378448
20:07:37  GDB OUT x10            0xffff92acf650      281473142552144
20:07:37  GDB OUT x11            0xaaaad8de9a48      187650759629384
20:07:37  GDB OUT x12            0x0                 0
20:07:37  GDB OUT x13            0xaaaad8d0e228      187650758730280
20:07:37  GDB OUT x14            0x8                 8
20:07:37  GDB OUT x15            0x48                72
20:07:37  GDB OUT x16            0xaaaad8ddee68      187650759585384
20:07:37  GDB OUT x17            0xffff928f38d8      281473140603096
20:07:37  GDB OUT x18            0x0                 0
20:07:37  GDB OUT x19            0xffffffffffffffff  -1
20:07:37  GDB OUT x20            0xaaaad8de0000      187650759589888
20:07:37  GDB OUT x21            0xaaaad8ddf000      187650759585792
20:07:37  GDB OUT x22            0xaaaad8ddf000      187650759585792
20:07:37  GDB OUT x23            0x0                 0
20:07:37  GDB OUT x24            0x1                 1
20:07:37  GDB OUT x25            0xaaaad8ddf000      187650759585792
20:07:37  GDB OUT x26            0xaaaad8de06c0      187650759591616
20:07:37  GDB OUT x27            0xaaaad8dece88      187650759642760
20:07:37  GDB OUT x28            0x0                 0
20:07:37  GDB OUT x29            0xffffd0b43760      281474183214944
20:07:37  GDB OUT x30            0xaaaad8d0ae80      187650758717056
20:07:37  GDB OUT sp             0xffffd0b43760      0xffffd0b43760
20:07:37  GDB OUT pc             0xffff928f3908      0xffff928f3908 <waitpid+48>
20:07:37  GDB OUT cpsr           0x60001000          [ EL=0 C Z ]
20:07:37  GDB OUT fpsr           0x0                 0
20:07:37  GDB OUT fpcr           0x0                 0
20:07:37  GDB OUT   Id   Target Id              Frame 
20:07:37  GDB OUT * 1    process 1426201 "bash" 0x0000ffff928f3908 in waitpid () from /lib64/libc.so.6
20:07:37  GDB OUT 
20:07:37  GDB OUT Thread 1 (process 1426201):
20:07:37  GDB OUT #0  0x0000ffff928f3908 in waitpid () from /lib64/libc.so.6
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #1  0x0000aaaad8d0ae80 in waitchld.isra ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #2  0x0000aaaad8d0c5ac in wait_for ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #3  0x0000aaaad8cfab2c in execute_command_internal ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #4  0x0000aaaad8cf9c9c in execute_command_internal ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #5  0x0000aaaad8cfadb8 in execute_command ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #6  0x0000aaaad8cf8e30 in execute_command_internal ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #7  0x0000aaaad8cf9c9c in execute_command_internal ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #8  0x0000aaaad8cfadb8 in execute_command ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #9  0x0000aaaad8cf8688 in execute_command_internal ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #10 0x0000aaaad8cfadb8 in execute_command ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #11 0x0000aaaad8ce28bc in reader_loop ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT #12 0x0000aaaad8ce0e40 in main ()
20:07:37  GDB OUT No symbol table info available.
20:07:37  GDB OUT Saved corefile core.1426201.1
20:07:37  GDB OUT [Inferior 1 (process 1426201) detached]
20:07:37  INFO: Running '/usr/bin/gdb' failed with rc = 1
20:07:37  GDB ERR warning: target file /proc/1426201/cmdline contained unexpected null characters
20:07:37  GDB ERR warning: Memory read failed for corefile section, 131072 bytes at 0xffff92a60000.
20:07:37  GDB ERR /tmp/debugger2101984825186466203.txt:6: Error in sourced command file:
20:07:37  GDB ERR Requires argument (inferior id(s) to detach)
20:07:37  
20:07:37  INFO: Sleep for 60000 millis before next capture.
20:08:28  ***[TEST INFO 2024/02/07 20:08:22] executing /usr/bin/gdb -batch -x /tmp/debugger2101984825186466203.txt bash 1426201***
20:08:28  GDB OUT 0x0000ffff928f3908 in waitpid () from /lib64/libc.so.6
20:08:28  GDB OUT From                To                  Syms Read   Shared Object Library
20:08:28  GDB OUT 0x0000ffff92a0e010  0x0000ffff92a1aad4  Yes (*)     /lib64/libtinfo.so.6
20:08:28  GDB OUT 0x0000ffff929d0f50  0x0000ffff929d1d74  Yes (*)     /lib64/libdl.so.2
20:08:28  GDB OUT 0x0000ffff928707c0  0x0000ffff92960a18  Yes (*)     /lib64/libc.so.6
20:08:28  GDB OUT 0x0000ffff92a90f80  0x0000ffff92aaaa18  Yes (*)     /lib/ld-linux-aarch64.so.1
20:08:28  GDB OUT (*): Shared library is missing debugging information.
20:08:28  GDB OUT x0             0xffffffffffffffff  -1
20:08:28  GDB OUT x1             0xffffd0b43820      281474183215136
20:08:28  GDB OUT x2             0x0                 0
20:08:28  GDB OUT x3             0x0                 0
20:08:28  GDB OUT x4             0x1                 1
20:08:28  GDB OUT x5             0xaaab13163c50      187651736353872
20:08:28  GDB OUT x6             0x15c381            1426305
20:08:28  GDB OUT x7             0x0                 0
20:08:28  GDB OUT x8             0x104               260
20:08:28  GDB OUT x9             0xaaab13169c50      187651736378448
20:08:28  GDB OUT x10            0xffff92acf650      281473142552144
20:08:28  GDB OUT x11            0xaaaad8de9a48      187650759629384
20:08:28  GDB OUT x12            0x0                 0
20:08:28  GDB OUT x13            0xaaaad8d0e228      187650758730280
20:08:28  GDB OUT x14            0x8                 8
20:08:28  GDB OUT x15            0x48                72
20:08:28  GDB OUT x16            0xaaaad8ddee68      187650759585384
20:08:28  GDB OUT x17            0xffff928f38d8      281473140603096
20:08:28  GDB OUT x18            0x0                 0
20:08:28  GDB OUT x19            0xffffffffffffffff  -1
20:08:28  GDB OUT x20            0xaaaad8de0000      187650759589888
20:08:28  GDB OUT x21            0xaaaad8ddf000      187650759585792
20:08:28  GDB OUT x22            0xaaaad8ddf000      187650759585792
20:08:28  GDB OUT x23            0x0                 0
20:08:28  GDB OUT x24            0x1                 1
20:08:28  GDB OUT x25            0xaaaad8ddf000      187650759585792
20:08:28  GDB OUT x26            0xaaaad8de06c0      187650759591616
20:08:28  GDB OUT x27            0xaaaad8dece88      187650759642760
20:08:28  GDB OUT x28            0x0                 0
20:08:28  GDB OUT x29            0xffffd0b43760      281474183214944
20:08:28  GDB OUT x30            0xaaaad8d0ae80      187650758717056
20:08:28  GDB OUT sp             0xffffd0b43760      0xffffd0b43760
20:08:28  GDB OUT pc             0xffff928f3908      0xffff928f3908 <waitpid+48>
20:08:28  GDB OUT cpsr           0x60001000          [ EL=0 C Z ]
20:08:28  GDB OUT fpsr           0x0                 0
20:08:28  GDB OUT fpcr           0x0                 0
20:08:28  GDB OUT   Id   Target Id              Frame 
20:08:28  GDB OUT * 1    process 1426201 "bash" 0x0000ffff928f3908 in waitpid () from /lib64/libc.so.6
20:08:28  GDB OUT 
20:08:28  GDB OUT Thread 1 (process 1426201):
20:08:28  GDB OUT #0  0x0000ffff928f3908 in waitpid () from /lib64/libc.so.6
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #1  0x0000aaaad8d0ae80 in waitchld.isra ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #2  0x0000aaaad8d0c5ac in wait_for ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #3  0x0000aaaad8cfab2c in execute_command_internal ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #4  0x0000aaaad8cf9c9c in execute_command_internal ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #5  0x0000aaaad8cfadb8 in execute_command ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #6  0x0000aaaad8cf8e30 in execute_command_internal ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #7  0x0000aaaad8cf9c9c in execute_command_internal ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #8  0x0000aaaad8cfadb8 in execute_command ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #9  0x0000aaaad8cf8688 in execute_command_internal ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #10 0x0000aaaad8cfadb8 in execute_command ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #11 0x0000aaaad8ce28bc in reader_loop ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT #12 0x0000aaaad8ce0e40 in main ()
20:08:28  GDB OUT No symbol table info available.
20:08:28  GDB OUT Saved corefile core.1426201.2
20:08:28  GDB OUT A debugging session is active.
20:08:28  GDB OUT 
20:08:28  GDB OUT 	Inferior 1 [process 1426201] will be detached.
20:08:28  GDB OUT 
20:08:28  GDB OUT Quit anyway? (y or n) [answered Y; input not from terminal]
20:08:28  GDB OUT [Inferior 1 (process 1426201) detached]
20:08:28  ***[TEST INFO 2024/02/07 20:08:23] executing kill -ABRT 1426201***
20:08:28  ***[TEST INFO 2024/02/07 20:08:23] kill -ABRT signal sent***
20:08:28  Time spent executing: 360780 milliseconds
20:08:28  Test result: FAILED
20:08:28  Output from test:
20:08:28   [OUT] start running script
20:08:28   [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
20:08:28   [OUT] export LD_BIND_NOT=on
20:08:28   [OUT] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1  -cp /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3
20:08:28   [ERR] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41: 1426205 Killed                  $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1

pshipton avatar Feb 08 '24 14:02 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/629 cmdLineTester_criu_nonPortableRestore_9

21:47:26  Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
21:47:26  Test start time: 2024/02/15 02:47:26 Coordinated Universal Time
21:47:26  Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/bin/java " -XX:+DebugOnRestore -Xjit " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
21:47:26  Time spent starting: 5 milliseconds
21:52:41  ***[TEST INFO 2024/02/15 02:52:26] ProcessKiller detected a timeout after 300000 milliseconds!***
21:52:41  ***[TEST INFO 2024/02/15 02:52:26] executing /usr/bin/gdb -batch -x /tmp/debugger3113438877414474975.txt bash 1075116***
21:52:41  GDB OUT No shared libraries loaded at this time.
21:52:41  INFO: Running '/usr/bin/gdb' failed with rc = 1
21:52:41  GDB ERR Could not attach to process.  If your uid matches the uid of the target
21:52:41  GDB ERR process, check the setting of /proc/sys/kernel/yama/ptrace_scope, or try
21:52:41  GDB ERR again as the root user.  For more details, see /etc/sysctl.d/10-ptrace.conf
21:52:41  GDB ERR ptrace: Operation not permitted.
21:52:41  GDB ERR /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/output_17079610289898/cmdLineTester_criu_nonPortableRestore_9/1075116: No such file or directory.
21:52:41  GDB ERR /tmp/debugger3113438877414474975.txt:2: Error in sourced command file:
21:52:41  GDB ERR The program has no registers now.
21:52:41  
21:52:41  INFO: Sleep for 60000 millis before next capture.
21:53:32  ***[TEST INFO 2024/02/15 02:53:26] executing /usr/bin/gdb -batch -x /tmp/debugger3113438877414474975.txt bash 1075116***
21:53:32  GDB OUT No shared libraries loaded at this time.
21:53:32  INFO: Running '/usr/bin/gdb' failed with rc = 1
21:53:32  GDB ERR Could not attach to process.  If your uid matches the uid of the target
21:53:32  GDB ERR process, check the setting of /proc/sys/kernel/yama/ptrace_scope, or try
21:53:32  GDB ERR again as the root user.  For more details, see /etc/sysctl.d/10-ptrace.conf
21:53:32  GDB ERR ptrace: Operation not permitted.
21:53:32  GDB ERR /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/output_17079610289898/cmdLineTester_criu_nonPortableRestore_9/1075116: No such file or directory.
21:53:32  GDB ERR /tmp/debugger3113438877414474975.txt:2: Error in sourced command file:
21:53:32  GDB ERR The program has no registers now.
21:53:32  
21:53:32  ***[TEST INFO 2024/02/15 02:53:27] executing kill -ABRT 1075116***
21:53:32  ***[TEST INFO 2024/02/15 02:53:27] kill -ABRT signal sent***
21:53:32  Time spent executing: 360625 milliseconds
21:53:32  Test result: FAILED
21:53:32  Output from test:
21:53:32   [OUT] start running script
21:53:32   [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
21:53:32   [OUT] export LD_BIND_NOT=on
21:53:32   [OUT] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -XX:+DebugOnRestore -Xjit  -cp /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3
21:53:32   [ERR] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41: 1075120 Killed                  $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1

pshipton avatar Feb 15 '24 16:02 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.functional_x86-64_linux_Nightly_testList_1/110 cmdLineTester_criu_nonPortableRestore_1

20:15:31  Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
20:15:31  Test start time: 2024/02/14 20:54:18 Atlantic Standard Time
20:15:31  Running command: bash /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_x86-64_linux_Nightly_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_x86-64_linux_Nightly_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_x86-64_linux_Nightly_testList_1/jdkbinary/j2sdk-image/bin/java " -Xint -XX:+CRIURestoreNonPortableMode " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
20:15:31  Time spent starting: 5 milliseconds
20:15:31  ***[TEST INFO 2024/02/14 20:59:18] ProcessKiller detected a timeout after 300000 milliseconds!***
20:15:31  ***[TEST INFO 2024/02/14 20:59:18] executing /usr/bin/gdb -batch -x /tmp/debugger8680507940657613222.txt bash 8816***
20:15:31  GDB OUT 0x00007fbafda4f60c in waitpid () from /lib64/libc.so.6
20:15:31  GDB OUT From                To                  Syms Read   Shared Object Library
20:15:31  GDB OUT 0x00007fbafdf68e40  0x00007fbafdf74bb8  Yes (*)     /lib64/libtinfo.so.5
20:15:31  GDB OUT 0x00007fbafdd58e50  0x00007fbafdd5994e  Yes (*)     /lib64/libdl.so.2
20:15:31  GDB OUT 0x00007fbafd9a99f0  0x00007fbafdaf9b6f  Yes (*)     /lib64/libc.so.6
20:15:31  GDB OUT 0x00007fbafe186af0  0x00007fbafe1a2060  Yes (*)     /lib64/ld-linux-x86-64.so.2
20:15:31  GDB OUT (*): Shared library is missing debugging information.
20:15:31  GDB OUT rax            0xfffffffffffffe00	-512
20:15:31  GDB OUT rbx            0x0	0
20:15:31  GDB OUT rcx            0xffffffffffffffff	-1
20:15:31  GDB OUT rdx            0x0	0
20:15:31  GDB OUT rsi            0x7fff659b2df0	140734898056688
20:15:31  GDB OUT rdi            0xffffffffffffffff	-1
20:15:31  GDB OUT rbp            0xfce6e0	0xfce6e0
20:15:31  GDB OUT rsp            0x7fff659b2dc8	0x7fff659b2dc8
20:15:31  GDB OUT r8             0xfce6e0	16574176
20:15:31  GDB OUT r9             0x0	0
20:15:31  GDB OUT r10            0x0	0
20:15:31  GDB OUT r11            0x246	582
20:15:31  GDB OUT r12            0x0	0
20:15:31  GDB OUT r13            0x1	1
20:15:31  GDB OUT r14            0xfc8db0	16551344
20:15:31  GDB OUT r15            0x0	0
20:15:31  GDB OUT rip            0x7fbafda4f60c	0x7fbafda4f60c <waitpid+28>
20:15:31  GDB OUT eflags         0x246	[ PF ZF IF ]
20:15:31  GDB OUT cs             0x33	51
20:15:31  GDB OUT ss             0x2b	43
20:15:31  GDB OUT ds             0x0	0
20:15:31  GDB OUT es             0x0	0
20:15:31  GDB OUT fs             0x0	0
20:15:31  GDB OUT gs             0x0	0
20:15:31  GDB OUT   Id   Target Id         Frame 
20:15:31  GDB OUT * 1    process 8816 "bash" 0x00007fbafda4f60c in waitpid () from /lib64/libc.so.6
20:15:31  GDB OUT 
20:15:31  GDB OUT Thread 1 (process 8816):
20:15:31  GDB OUT #0  0x00007fbafda4f60c in waitpid () from /lib64/libc.so.6
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #1  0x0000000000440c34 in waitchld.isra.10 ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #2  0x0000000000441eec in wait_for ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #3  0x0000000000433b1e in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #4  0x00000000004329c3 in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #5  0x0000000000433d3e in execute_command ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #6  0x00000000004327be in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #7  0x00000000004329c3 in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #8  0x0000000000433d3e in execute_command ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #9  0x0000000000432461 in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #10 0x0000000000433d3e in execute_command ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #11 0x000000000041e375 in reader_loop ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #12 0x000000000041c9de in main ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT Saved corefile core.8816.1
20:15:31  GDB OUT [Inferior 1 (process 8816) detached]
20:15:31  INFO: Sleep for 60000 millis before next capture.
20:15:31  ***[TEST INFO 2024/02/14 21:00:22] executing /usr/bin/gdb -batch -x /tmp/debugger8680507940657613222.txt bash 8816***
20:15:31  GDB OUT 0x00007fbafda4f60c in waitpid () from /lib64/libc.so.6
20:15:31  GDB OUT From                To                  Syms Read   Shared Object Library
20:15:31  GDB OUT 0x00007fbafdf68e40  0x00007fbafdf74bb8  Yes (*)     /lib64/libtinfo.so.5
20:15:31  GDB OUT 0x00007fbafdd58e50  0x00007fbafdd5994e  Yes (*)     /lib64/libdl.so.2
20:15:31  GDB OUT 0x00007fbafd9a99f0  0x00007fbafdaf9b6f  Yes (*)     /lib64/libc.so.6
20:15:31  GDB OUT 0x00007fbafe186af0  0x00007fbafe1a2060  Yes (*)     /lib64/ld-linux-x86-64.so.2
20:15:31  GDB OUT (*): Shared library is missing debugging information.
20:15:31  GDB OUT rax            0xfffffffffffffe00	-512
20:15:31  GDB OUT rbx            0x0	0
20:15:31  GDB OUT rcx            0xffffffffffffffff	-1
20:15:31  GDB OUT rdx            0x0	0
20:15:31  GDB OUT rsi            0x7fff659b2df0	140734898056688
20:15:31  GDB OUT rdi            0xffffffffffffffff	-1
20:15:31  GDB OUT rbp            0xfce6e0	0xfce6e0
20:15:31  GDB OUT rsp            0x7fff659b2dc8	0x7fff659b2dc8
20:15:31  GDB OUT r8             0xfce6e0	16574176
20:15:31  GDB OUT r9             0x0	0
20:15:31  GDB OUT r10            0x0	0
20:15:31  GDB OUT r11            0x246	582
20:15:31  GDB OUT r12            0x0	0
20:15:31  GDB OUT r13            0x1	1
20:15:31  GDB OUT r14            0xfc8db0	16551344
20:15:31  GDB OUT r15            0x0	0
20:15:31  GDB OUT rip            0x7fbafda4f60c	0x7fbafda4f60c <waitpid+28>
20:15:31  GDB OUT eflags         0x246	[ PF ZF IF ]
20:15:31  GDB OUT cs             0x33	51
20:15:31  GDB OUT ss             0x2b	43
20:15:31  GDB OUT ds             0x0	0
20:15:31  GDB OUT es             0x0	0
20:15:31  GDB OUT fs             0x0	0
20:15:31  GDB OUT gs             0x0	0
20:15:31  GDB OUT   Id   Target Id         Frame 
20:15:31  GDB OUT * 1    process 8816 "bash" 0x00007fbafda4f60c in waitpid () from /lib64/libc.so.6
20:15:31  GDB OUT 
20:15:31  GDB OUT Thread 1 (process 8816):
20:15:31  GDB OUT #0  0x00007fbafda4f60c in waitpid () from /lib64/libc.so.6
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #1  0x0000000000440c34 in waitchld.isra.10 ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #2  0x0000000000441eec in wait_for ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #3  0x0000000000433b1e in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #4  0x00000000004329c3 in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #5  0x0000000000433d3e in execute_command ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #6  0x00000000004327be in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #7  0x00000000004329c3 in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #8  0x0000000000433d3e in execute_command ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #9  0x0000000000432461 in execute_command_internal ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #10 0x0000000000433d3e in execute_command ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #11 0x000000000041e375 in reader_loop ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT #12 0x000000000041c9de in main ()
20:15:31  GDB OUT No symbol table info available.
20:15:31  GDB OUT Saved corefile core.8816.2
20:15:31  GDB OUT A debugging session is active.
20:15:31  GDB OUT 
20:15:31  GDB OUT 	Inferior 1 [process 8816] will be detached.
20:15:31  GDB OUT 
20:15:31  GDB OUT Quit anyway? (y or n) [answered Y; input not from terminal]
20:15:31  GDB OUT [Inferior 1 (process 8816) detached]
20:15:31  ***[TEST INFO 2024/02/14 21:00:26] executing kill -ABRT 8816***
20:15:31  ***[TEST INFO 2024/02/14 21:00:26] kill -ABRT signal sent***
20:15:31  Time spent executing: 368390 milliseconds
20:15:31  Test result: FAILED
20:15:31  Output from test:
20:15:31   [OUT] start running script
20:15:31   [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
20:15:31   [OUT] export LD_BIND_NOT=on
20:15:31   [OUT] /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_x86-64_linux_Nightly_testList_1/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -Xint -XX:+CRIURestoreNonPortableMode  -cp /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_x86-64_linux_Nightly_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3
20:15:31   [ERR] /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_x86-64_linux_Nightly_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41:  8819 Killed                  $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1

pshipton avatar Feb 15 '24 19:02 pshipton

https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk11_j9_sanity.functional_s390x_linux_ojdk292_Personal_testList_1/6/ - rhel9s390x-svl-rt9-1.fyre.ibm.com cmdLineTester_criu_nonPortableRestore_5

Expand Output
Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
Test start time: 2024/02/09 08:00:25 Pacific Standard Time
Running command: bash /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_ojdk292_Personal_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_ojdk292_Personal_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_ojdk292_Personal_testList_1/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:optthruput " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
Time spent starting: 3 milliseconds
***[TEST INFO 2024/02/09 08:05:25] ProcessKiller detected a timeout after 300000 milliseconds!***
***[TEST INFO 2024/02/09 08:05:25] executing /usr/bin/gdb -batch -x /tmp/debugger528548630677131819.txt bash 514610***
GDB OUT [Thread debugging using libthread_db enabled]
GDB OUT Using host libthread_db library "/lib64/libthread_db.so.1".
GDB OUT 0x000003ff8badc316 in wait4 () from /lib64/libc.so.6
GDB OUT From                To                  Syms Read   Shared Object Library
GDB OUT 0x000003ff8bd0ece0  0x000003ff8bd1c7e0  Yes (*)     /lib64/libtinfo.so.6
GDB OUT 0x000003ff8ba2a220  0x000003ff8bb67cf0  Yes (*)     /lib64/libc.so.6
GDB OUT 0x000003ff8be01d10  0x000003ff8be21350  Yes         /lib/ld64.so.1
GDB OUT (*): Shared library is missing debugging information.
GDB OUT pswm           0x705000180000000   505810539591499776
GDB OUT pswa           0x3ff8badc316       4396094964502
GDB OUT r0             0x1                 1
GDB OUT r1             0x3ff00000000       4393751543808
GDB OUT r2             0xfffffffffffffe00  18446744073709551104
GDB OUT r3             0x3ffda372a48       4397412592200
GDB OUT r4             0x0                 0
GDB OUT r5             0x0                 0
GDB OUT r6             0x3ffda372a48       4397412592200
GDB OUT r7             0x3ffda372c40       4397412592704
GDB OUT r8             0x3ff00000000       4393751543808
GDB OUT r9             0x3ff00000000       4393751543808
GDB OUT r10            0x3ff8be76c00       4396098743296
GDB OUT r11            0x7da59             514649
GDB OUT r12            0x3ff8be2ef68       4396098449256
GDB OUT r13            0x3ffda372b28       4397412592424
GDB OUT r14            0x2aa32824128       2930015093032
GDB OUT r15            0x3ffda3728e8       4397412591848
GDB OUT acr0           0x3ff               1023
GDB OUT acr1           0x8be76c00          2347199488
GDB OUT acr2           0x0                 0
GDB OUT acr3           0x0                 0
GDB OUT acr4           0x0                 0
GDB OUT acr5           0x0                 0
GDB OUT acr6           0x0                 0
GDB OUT acr7           0x0                 0
GDB OUT acr8           0x0                 0
GDB OUT acr9           0x0                 0
GDB OUT acr10          0x0                 0
GDB OUT acr11          0x0                 0
GDB OUT acr12          0x0                 0
GDB OUT acr13          0x0                 0
GDB OUT acr14          0x0                 0
GDB OUT acr15          0x0                 0
GDB OUT fpc            0x0                 0
GDB OUT orig_r2        0xffffffffffffffff  18446744073709551615
GDB OUT last_break     0x3ff8baae9d2       0x3ff8baae9d2 <malloc+98>
GDB OUT system_call    0x20072             131186
GDB OUT tdb0           <unavailable>
GDB OUT tac            <unavailable>
GDB OUT tct            <unavailable>
GDB OUT atia           <unavailable>
GDB OUT tr0            <unavailable>
GDB OUT tr1            <unavailable>
GDB OUT tr2            <unavailable>
GDB OUT tr3            <unavailable>
GDB OUT tr4            <unavailable>
GDB OUT tr5            <unavailable>
GDB OUT tr6            <unavailable>
GDB OUT tr7            <unavailable>
GDB OUT tr8            <unavailable>
GDB OUT tr9            <unavailable>
GDB OUT tr10           <unavailable>
GDB OUT tr11           <unavailable>
GDB OUT tr12           <unavailable>
GDB OUT tr13           <unavailable>
GDB OUT tr14           <unavailable>
GDB OUT tr15           <unavailable>
GDB OUT gsd            <unavailable>
GDB OUT gssm           <unavailable>
GDB OUT gsepla         <unavailable>
GDB OUT bc_gsd         <unavailable>
GDB OUT bc_gssm        <unavailable>
GDB OUT bc_gsepla      <unavailable>
GDB OUT pc             0x3ff8badc316       0x3ff8badc316 <wait4+38>
GDB OUT cc             0x0                 0
GDB OUT   Id   Target Id                                Frame 
GDB OUT * 1    Thread 0x3ff8be76c00 (LWP 514610) "bash" 0x000003ff8badc316 in wait4 () from /lib64/libc.so.6
GDB OUT 
GDB OUT Thread 1 (Thread 0x3ff8be76c00 (LWP 514610) "bash"):
GDB OUT #0  0x000003ff8badc316 in wait4 () from /lib64/libc.so.6
GDB OUT No symbol table info available.
GDB OUT #1  0x000002aa32824128 in waitchld.constprop ()
GDB OUT No symbol table info available.
GDB OUT #2  0x000002aa3276c592 in wait_for ()
GDB OUT No symbol table info available.
GDB OUT #3  0x000002aa3275117c in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #4  0x000002aa3274f120 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #5  0x000002aa327512bc in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #6  0x000002aa3274ebd2 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #7  0x000002aa3274f120 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #8  0x000002aa327512bc in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #9  0x000002aa3274e992 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #10 0x000002aa327512bc in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #11 0x000002aa3274090a in reader_loop ()
GDB OUT No symbol table info available.
GDB OUT #12 0x000002aa32730624 in main ()
GDB OUT No symbol table info available.
GDB OUT Saved corefile core.514610.1
GDB OUT [Inferior 1 (process 514610) detached]
INFO: Running '/usr/bin/gdb' failed with rc = 1
GDB ERR warning: target file /proc/514610/cmdline contained unexpected null characters
GDB ERR /tmp/debugger528548630677131819.txt:6: Error in sourced command file:
GDB ERR Requires argument (inferior id(s) to detach)

INFO: Sleep for 60000 millis before next capture.
***[TEST INFO 2024/02/09 08:06:25] executing /usr/bin/gdb -batch -x /tmp/debugger528548630677131819.txt bash 514610***
GDB OUT [Thread debugging using libthread_db enabled]
GDB OUT Using host libthread_db library "/lib64/libthread_db.so.1".
GDB OUT 0x000003ff8badc316 in wait4 () from /lib64/libc.so.6
GDB OUT From                To                  Syms Read   Shared Object Library
GDB OUT 0x000003ff8bd0ece0  0x000003ff8bd1c7e0  Yes (*)     /lib64/libtinfo.so.6
GDB OUT 0x000003ff8ba2a220  0x000003ff8bb67cf0  Yes (*)     /lib64/libc.so.6
GDB OUT 0x000003ff8be01d10  0x000003ff8be21350  Yes         /lib/ld64.so.1
GDB OUT (*): Shared library is missing debugging information.
GDB OUT pswm           0x705000180000000   505810539591499776
GDB OUT pswa           0x3ff8badc316       4396094964502
GDB OUT r0             0x1                 1
GDB OUT r1             0x3ff00000000       4393751543808
GDB OUT r2             0xfffffffffffffe00  18446744073709551104
GDB OUT r3             0x3ffda372a48       4397412592200
GDB OUT r4             0x0                 0
GDB OUT r5             0x0                 0
GDB OUT r6             0x3ffda372a48       4397412592200
GDB OUT r7             0x3ffda372c40       4397412592704
GDB OUT r8             0x3ff00000000       4393751543808
GDB OUT r9             0x3ff00000000       4393751543808
GDB OUT r10            0x3ff8be76c00       4396098743296
GDB OUT r11            0x7da59             514649
GDB OUT r12            0x3ff8be2ef68       4396098449256
GDB OUT r13            0x3ffda372b28       4397412592424
GDB OUT r14            0x2aa32824128       2930015093032
GDB OUT r15            0x3ffda3728e8       4397412591848
GDB OUT acr0           0x3ff               1023
GDB OUT acr1           0x8be76c00          2347199488
GDB OUT acr2           0x0                 0
GDB OUT acr3           0x0                 0
GDB OUT acr4           0x0                 0
GDB OUT acr5           0x0                 0
GDB OUT acr6           0x0                 0
GDB OUT acr7           0x0                 0
GDB OUT acr8           0x0                 0
GDB OUT acr9           0x0                 0
GDB OUT acr10          0x0                 0
GDB OUT acr11          0x0                 0
GDB OUT acr12          0x0                 0
GDB OUT acr13          0x0                 0
GDB OUT acr14          0x0                 0
GDB OUT acr15          0x0                 0
GDB OUT fpc            0x0                 0
GDB OUT orig_r2        0xffffffffffffffff  18446744073709551615
GDB OUT last_break     0x3ff8baae9d2       0x3ff8baae9d2 <malloc+98>
GDB OUT system_call    0x20072             131186
GDB OUT tdb0           <unavailable>
GDB OUT tac            <unavailable>
GDB OUT tct            <unavailable>
GDB OUT atia           <unavailable>
GDB OUT tr0            <unavailable>
GDB OUT tr1            <unavailable>
GDB OUT tr2            <unavailable>
GDB OUT tr3            <unavailable>
GDB OUT tr4            <unavailable>
GDB OUT tr5            <unavailable>
GDB OUT tr6            <unavailable>
GDB OUT tr7            <unavailable>
GDB OUT tr8            <unavailable>
GDB OUT tr9            <unavailable>
GDB OUT tr10           <unavailable>
GDB OUT tr11           <unavailable>
GDB OUT tr12           <unavailable>
GDB OUT tr13           <unavailable>
GDB OUT tr14           <unavailable>
GDB OUT tr15           <unavailable>
GDB OUT gsd            <unavailable>
GDB OUT gssm           <unavailable>
GDB OUT gsepla         <unavailable>
GDB OUT bc_gsd         <unavailable>
GDB OUT bc_gssm        <unavailable>
GDB OUT bc_gsepla      <unavailable>
GDB OUT pc             0x3ff8badc316       0x3ff8badc316 <wait4+38>
GDB OUT cc             0x0                 0
GDB OUT   Id   Target Id                                Frame 
GDB OUT * 1    Thread 0x3ff8be76c00 (LWP 514610) "bash" 0x000003ff8badc316 in wait4 () from /lib64/libc.so.6
GDB OUT 
GDB OUT Thread 1 (Thread 0x3ff8be76c00 (LWP 514610) "bash"):
GDB OUT #0  0x000003ff8badc316 in wait4 () from /lib64/libc.so.6
GDB OUT No symbol table info available.
GDB OUT #1  0x000002aa32824128 in waitchld.constprop ()
GDB OUT No symbol table info available.
GDB OUT #2  0x000002aa3276c592 in wait_for ()
GDB OUT No symbol table info available.
GDB OUT #3  0x000002aa3275117c in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #4  0x000002aa3274f120 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #5  0x000002aa327512bc in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #6  0x000002aa3274ebd2 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #7  0x000002aa3274f120 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #8  0x000002aa327512bc in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #9  0x000002aa3274e992 in execute_command_internal ()
GDB OUT No symbol table info available.
GDB OUT #10 0x000002aa327512bc in execute_command ()
GDB OUT No symbol table info available.
GDB OUT #11 0x000002aa3274090a in reader_loop ()
GDB OUT No symbol table info available.
GDB OUT #12 0x000002aa32730624 in main ()
GDB OUT No symbol table info available.
GDB OUT Saved corefile core.514610.2
GDB OUT A debugging session is active.
GDB OUT 
GDB OUT 	Inferior 1 [process 514610] will be detached.
GDB OUT 
GDB OUT Quit anyway? (y or n) [answered Y; input not from terminal]
GDB OUT [Inferior 1 (process 514610) detached]
***[TEST INFO 2024/02/09 08:06:25] executing kill -ABRT 514610***
Time spent executing: 360463 milliseconds
Test result: FAILED
Output from test:
 [OUT] start running script
 [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load
 [OUT] export LD_BIND_NOT=on
 [OUT] /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_ojdk292_Personal_testList_1/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport  -Xgcpolicy:optthruput  -cp /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_ojdk292_Personal_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3
 [ERR] /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_s390x_linux_ojdk292_Personal_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41: 514614 Killed                  $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1

ThanHenderson avatar Feb 21 '24 16:02 ThanHenderson

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.functional_x86-64_linux_OMR_testList_1/405 - cent7-x64-5 cmdLineTester_criu_nonPortableRestore_7

Test output 07:26:32 Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone 07:26:32 Test start time: 2024/03/01 08:26:30 Atlantic Standard Time 07:26:32 Running command: bash /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_x86-64_linux_OMR_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_x86-64_linux_OMR_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_x86-64_linux_OMR_testList_1/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1 " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false 07:26:32 Time spent starting: 3 milliseconds 07:31:43 ***[TEST INFO 2024/03/01 08:31:30] ProcessKiller detected a timeout after 300000 milliseconds!*** 07:31:43 ***[TEST INFO 2024/03/01 08:31:31] executing /usr/bin/gdb -batch -x /tmp/debugger17400774259479726724.txt bash 2667*** 07:31:43 GDB OUT 0x00007fcb92ff460c in waitpid () from /lib64/libc.so.6 07:31:43 GDB OUT From To Syms Read Shared Object Library 07:31:43 GDB OUT 0x00007fcb9350de40 0x00007fcb93519bb8 Yes (*) /lib64/libtinfo.so.5 07:31:43 GDB OUT 0x00007fcb932fde50 0x00007fcb932fe94e Yes (*) /lib64/libdl.so.2 07:31:43 GDB OUT 0x00007fcb92f4e9f0 0x00007fcb9309eb6f Yes (*) /lib64/libc.so.6 07:31:43 GDB OUT 0x00007fcb9372baf0 0x00007fcb93747060 Yes (*) /lib64/ld-linux-x86-64.so.2 07:31:43 GDB OUT (*): Shared library is missing debugging information. 07:31:43 GDB OUT rax 0xfffffffffffffe00 -512 07:31:43 GDB OUT rbx 0x0 0 07:31:43 GDB OUT rcx 0xffffffffffffffff -1 07:31:43 GDB OUT rdx 0x0 0 07:31:43 GDB OUT rsi 0x7fff094c15b0 140733349369264 07:31:43 GDB OUT rdi 0xffffffffffffffff -1 07:31:43 GDB OUT rbp 0x2093e70 0x2093e70 07:31:43 GDB OUT rsp 0x7fff094c1588 0x7fff094c1588 07:31:43 GDB OUT r8 0x2093e70 34160240 07:31:43 GDB OUT r9 0x0 0 07:31:43 GDB OUT r10 0x0 0 07:31:43 GDB OUT r11 0x246 582 07:31:43 GDB OUT r12 0x0 0 07:31:43 GDB OUT r13 0x1 1 07:31:43 GDB OUT r14 0x208ed80 34139520 07:31:43 GDB OUT r15 0x0 0 07:31:43 GDB OUT rip 0x7fcb92ff460c 0x7fcb92ff460c 07:31:43 GDB OUT eflags 0x246 [ PF ZF IF ] 07:31:43 GDB OUT cs 0x33 51 07:31:43 GDB OUT ss 0x2b 43 07:31:43 GDB OUT ds 0x0 0 07:31:43 GDB OUT es 0x0 0 07:31:43 GDB OUT fs 0x0 0 07:31:43 GDB OUT gs 0x0 0 07:31:43 GDB OUT Id Target Id Frame 07:31:43 GDB OUT * 1 process 2667 "bash" 0x00007fcb92ff460c in waitpid () from /lib64/libc.so.6 07:31:43 GDB OUT 07:31:43 GDB OUT Thread 1 (process 2667): 07:31:43 GDB OUT #0 0x00007fcb92ff460c in waitpid () from /lib64/libc.so.6 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #1 0x0000000000440c34 in waitchld.isra.10 () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #2 0x0000000000441eec in wait_for () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #3 0x0000000000433b1e in execute_command_internal () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #4 0x00000000004329c3 in execute_command_internal () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #5 0x0000000000433d3e in execute_command () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #6 0x00000000004327be in execute_command_internal () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #7 0x00000000004329c3 in execute_command_internal () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #8 0x0000000000433d3e in execute_command () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #9 0x0000000000432461 in execute_command_internal () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #10 0x0000000000433d3e in execute_command () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #11 0x000000000041e375 in reader_loop () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT #12 0x000000000041c9de in main () 07:31:43 GDB OUT No symbol table info available. 07:31:43 GDB OUT Saved corefile core.2667.1 07:31:43 GDB OUT [Inferior 1 (process 2667) detached] 07:31:43 INFO: Sleep for 60000 millis before next capture. 07:32:41 ***[TEST INFO 2024/03/01 08:32:35] executing /usr/bin/gdb -batch -x /tmp/debugger17400774259479726724.txt bash 2667*** 07:32:41 GDB OUT 0x00007fcb92ff460c in waitpid () from /lib64/libc.so.6 07:32:41 GDB OUT From To Syms Read Shared Object Library 07:32:41 GDB OUT 0x00007fcb9350de40 0x00007fcb93519bb8 Yes (*) /lib64/libtinfo.so.5 07:32:41 GDB OUT 0x00007fcb932fde50 0x00007fcb932fe94e Yes (*) /lib64/libdl.so.2 07:32:41 GDB OUT 0x00007fcb92f4e9f0 0x00007fcb9309eb6f Yes (*) /lib64/libc.so.6 07:32:41 GDB OUT 0x00007fcb9372baf0 0x00007fcb93747060 Yes (*) /lib64/ld-linux-x86-64.so.2 07:32:41 GDB OUT (*): Shared library is missing debugging information. 07:32:41 GDB OUT rax 0xfffffffffffffe00 -512 07:32:41 GDB OUT rbx 0x0 0 07:32:41 GDB OUT rcx 0xffffffffffffffff -1 07:32:41 GDB OUT rdx 0x0 0 07:32:41 GDB OUT rsi 0x7fff094c15b0 140733349369264 07:32:41 GDB OUT rdi 0xffffffffffffffff -1 07:32:41 GDB OUT rbp 0x2093e70 0x2093e70 07:32:41 GDB OUT rsp 0x7fff094c1588 0x7fff094c1588 07:32:41 GDB OUT r8 0x2093e70 34160240 07:32:41 GDB OUT r9 0x0 0 07:32:41 GDB OUT r10 0x0 0 07:32:41 GDB OUT r11 0x246 582 07:32:41 GDB OUT r12 0x0 0 07:32:41 GDB OUT r13 0x1 1 07:32:41 GDB OUT r14 0x208ed80 34139520 07:32:41 GDB OUT r15 0x0 0 07:32:41 GDB OUT rip 0x7fcb92ff460c 0x7fcb92ff460c 07:32:41 GDB OUT eflags 0x246 [ PF ZF IF ] 07:32:41 GDB OUT cs 0x33 51 07:32:41 GDB OUT ss 0x2b 43 07:32:41 GDB OUT ds 0x0 0 07:32:41 GDB OUT es 0x0 0 07:32:41 GDB OUT fs 0x0 0 07:32:41 GDB OUT gs 0x0 0 07:32:41 GDB OUT Id Target Id Frame 07:32:41 GDB OUT * 1 process 2667 "bash" 0x00007fcb92ff460c in waitpid () from /lib64/libc.so.6 07:32:41 GDB OUT 07:32:41 GDB OUT Thread 1 (process 2667): 07:32:41 GDB OUT #0 0x00007fcb92ff460c in waitpid () from /lib64/libc.so.6 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #1 0x0000000000440c34 in waitchld.isra.10 () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #2 0x0000000000441eec in wait_for () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #3 0x0000000000433b1e in execute_command_internal () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #4 0x00000000004329c3 in execute_command_internal () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #5 0x0000000000433d3e in execute_command () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #6 0x00000000004327be in execute_command_internal () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #7 0x00000000004329c3 in execute_command_internal () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #8 0x0000000000433d3e in execute_command () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #9 0x0000000000432461 in execute_command_internal () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #10 0x0000000000433d3e in execute_command () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #11 0x000000000041e375 in reader_loop () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT #12 0x000000000041c9de in main () 07:32:41 GDB OUT No symbol table info available. 07:32:41 GDB OUT Saved corefile core.2667.2 07:32:41 GDB OUT A debugging session is active. 07:32:41 GDB OUT 07:32:41 GDB OUT Inferior 1 [process 2667] will be detached. 07:32:41 GDB OUT 07:32:41 GDB OUT Quit anyway? (y or n) [answered Y; input not from terminal] 07:32:41 GDB OUT [Inferior 1 (process 2667) detached] 07:32:41 ***[TEST INFO 2024/03/01 08:32:39] executing kill -ABRT 2667*** 07:32:41 ***[TEST INFO 2024/03/01 08:32:39] kill -ABRT signal sent*** 07:32:41 Time spent executing: 368294 milliseconds 07:32:41 Test result: FAILED 07:32:41 Output from test: 07:32:41 [OUT] start running script 07:32:41 [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load 07:32:41 [OUT] export LD_BIND_NOT=on 07:32:41 [OUT] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_x86-64_linux_OMR_testList_1/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1 -cp /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_x86-64_linux_OMR_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3 07:32:41 [ERR] /home/jenkins/workspace/Test_openjdk17_j9_sanity.functional_x86-64_linux_OMR_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41: 2671 Killed $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1

pshipton avatar Mar 01 '24 17:03 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.functional_aarch64_linux_OMR_testList_1/91 cmdLineTester_criu_nonPortableRestore_7

Test output 07:13:01 Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone 07:13:01 Test start time: 2024/03/08 06:13:00 Eastern Standard Time 07:13:01 Running command: bash /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_OMR_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_OMR_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_OMR_testList_1/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1 " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false 07:13:01 Time spent starting: 4 milliseconds 07:18:00 ***[TEST INFO 2024/03/08 06:18:00] ProcessKiller detected a timeout after 300000 milliseconds!*** 07:18:00 ***[TEST INFO 2024/03/08 06:18:00] executing /usr/bin/gdb -batch -x /tmp/debugger16893846881193308072.txt bash 2853364*** 07:18:00 GDB OUT 0x0000ffff895f4778 in waitpid () from /lib64/libc.so.6 07:18:00 GDB OUT From To Syms Read Shared Object Library 07:18:00 GDB OUT 0x0000ffff8970e010 0x0000ffff8971aa14 Yes (*) /lib64/libtinfo.so.6 07:18:00 GDB OUT 0x0000ffff896d0cf0 0x0000ffff896d1974 Yes (*) /lib64/libdl.so.2 07:18:00 GDB OUT 0x0000ffff89570880 0x0000ffff89660c50 Yes (*) /lib64/libc.so.6 07:18:00 GDB OUT 0x0000ffff89791080 0x0000ffff897abd88 Yes /lib/ld-linux-aarch64.so.1 07:18:00 GDB OUT (*): Shared library is missing debugging information. 07:18:00 GDB OUT x0 0xffffffffffffffff -1 07:18:00 GDB OUT x1 0xffffe72cf650 281474560226896 07:18:00 GDB OUT x2 0x0 0 07:18:00 GDB OUT x3 0x0 0 07:18:00 GDB OUT x4 0x1 1 07:18:00 GDB OUT x5 0xaaaaff435e40 187651403767360 07:18:00 GDB OUT x6 0x2b8a5b 2853467 07:18:00 GDB OUT x7 0x0 0 07:18:00 GDB OUT x8 0x104 260 07:18:00 GDB OUT x9 0xaaaaff433dc0 187651403759040 07:18:00 GDB OUT x10 0xffff897cfb88 281472988412808 07:18:00 GDB OUT x11 0xaaaacaa89a48 187650521209416 07:18:00 GDB OUT x12 0x0 0 07:18:00 GDB OUT x13 0xaaaaca9ae2f8 187650520310520 07:18:00 GDB OUT x14 0x8 8 07:18:00 GDB OUT x15 0x28 40 07:18:00 GDB OUT x16 0xaaaacaa7ee68 187650521165416 07:18:00 GDB OUT x17 0xffff895f4748 281472986466120 07:18:00 GDB OUT x18 0x0 0 07:18:00 GDB OUT x19 0xffffffffffffffff -1 07:18:00 GDB OUT x20 0xaaaacaa80000 187650521169920 07:18:00 GDB OUT x21 0xaaaacaa7f000 187650521165824 07:18:00 GDB OUT x22 0xaaaacaa7f000 187650521165824 07:18:00 GDB OUT x23 0x0 0 07:18:00 GDB OUT x24 0x1 1 07:18:00 GDB OUT x25 0xaaaacaa7f000 187650521165824 07:18:00 GDB OUT x26 0xaaaacaa806c0 187650521171648 07:18:00 GDB OUT x27 0xaaaacaa8ce88 187650521222792 07:18:00 GDB OUT x28 0x0 0 07:18:00 GDB OUT x29 0xffffe72cf590 281474560226704 07:18:00 GDB OUT x30 0xaaaaca9aaf50 187650520297296 07:18:00 GDB OUT sp 0xffffe72cf590 0xffffe72cf590 07:18:00 GDB OUT pc 0xffff895f4778 0xffff895f4778 07:18:00 GDB OUT cpsr 0x60001000 [ EL=0 C Z ] 07:18:00 GDB OUT fpsr 0x0 0 07:18:00 GDB OUT fpcr 0x0 0 07:18:00 GDB OUT Id Target Id Frame 07:18:00 GDB OUT * 1 process 2853364 "bash" 0x0000ffff895f4778 in waitpid () from /lib64/libc.so.6 07:18:00 GDB OUT 07:18:00 GDB OUT Thread 1 (process 2853364): 07:18:00 GDB OUT #0 0x0000ffff895f4778 in waitpid () from /lib64/libc.so.6 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #1 0x0000aaaaca9aaf50 in waitchld.isra () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #2 0x0000aaaaca9ac67c in wait_for () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #3 0x0000aaaaca99abfc in execute_command_internal () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #4 0x0000aaaaca999d6c in execute_command_internal () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #5 0x0000aaaaca99ae88 in execute_command () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #6 0x0000aaaaca998f00 in execute_command_internal () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #7 0x0000aaaaca999d6c in execute_command_internal () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #8 0x0000aaaaca99ae88 in execute_command () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #9 0x0000aaaaca998758 in execute_command_internal () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #10 0x0000aaaaca99ae88 in execute_command () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #11 0x0000aaaaca98297c in reader_loop () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT #12 0x0000aaaaca980f00 in main () 07:18:00 GDB OUT No symbol table info available. 07:18:00 GDB OUT Saved corefile core.2853364.1 07:18:00 GDB OUT [Inferior 1 (process 2853364) detached] 07:18:00 INFO: Running '/usr/bin/gdb' failed with rc = 1 07:18:00 GDB ERR warning: target file /proc/2853364/cmdline contained unexpected null characters 07:18:00 GDB ERR warning: Memory read failed for corefile section, 131072 bytes at 0xffff89760000. 07:18:00 GDB ERR /tmp/debugger16893846881193308072.txt:6: Error in sourced command file: 07:18:00 GDB ERR Requires argument (inferior id(s) to detach) 07:18:00 07:18:00 INFO: Sleep for 60000 millis before next capture. 07:19:01 ***[TEST INFO 2024/03/08 06:19:00] executing /usr/bin/gdb -batch -x /tmp/debugger16893846881193308072.txt bash 2853364*** 07:19:01 GDB OUT 0x0000ffff895f4778 in waitpid () from /lib64/libc.so.6 07:19:01 GDB OUT From To Syms Read Shared Object Library 07:19:01 GDB OUT 0x0000ffff8970e010 0x0000ffff8971aa14 Yes (*) /lib64/libtinfo.so.6 07:19:01 GDB OUT 0x0000ffff896d0cf0 0x0000ffff896d1974 Yes (*) /lib64/libdl.so.2 07:19:01 GDB OUT 0x0000ffff89570880 0x0000ffff89660c50 Yes (*) /lib64/libc.so.6 07:19:01 GDB OUT 0x0000ffff89791080 0x0000ffff897abd88 Yes /lib/ld-linux-aarch64.so.1 07:19:01 GDB OUT (*): Shared library is missing debugging information. 07:19:01 GDB OUT x0 0xffffffffffffffff -1 07:19:01 GDB OUT x1 0xffffe72cf650 281474560226896 07:19:01 GDB OUT x2 0x0 0 07:19:01 GDB OUT x3 0x0 0 07:19:01 GDB OUT x4 0x1 1 07:19:01 GDB OUT x5 0xaaaaff435e40 187651403767360 07:19:01 GDB OUT x6 0x2b8a5b 2853467 07:19:01 GDB OUT x7 0x0 0 07:19:01 GDB OUT x8 0x104 260 07:19:01 GDB OUT x9 0xaaaaff433dc0 187651403759040 07:19:01 GDB OUT x10 0xffff897cfb88 281472988412808 07:19:01 GDB OUT x11 0xaaaacaa89a48 187650521209416 07:19:01 GDB OUT x12 0x0 0 07:19:01 GDB OUT x13 0xaaaaca9ae2f8 187650520310520 07:19:01 GDB OUT x14 0x8 8 07:19:01 GDB OUT x15 0x28 40 07:19:01 GDB OUT x16 0xaaaacaa7ee68 187650521165416 07:19:01 GDB OUT x17 0xffff895f4748 281472986466120 07:19:01 GDB OUT x18 0x0 0 07:19:01 GDB OUT x19 0xffffffffffffffff -1 07:19:01 GDB OUT x20 0xaaaacaa80000 187650521169920 07:19:01 GDB OUT x21 0xaaaacaa7f000 187650521165824 07:19:01 GDB OUT x22 0xaaaacaa7f000 187650521165824 07:19:01 GDB OUT x23 0x0 0 07:19:01 GDB OUT x24 0x1 1 07:19:01 GDB OUT x25 0xaaaacaa7f000 187650521165824 07:19:01 GDB OUT x26 0xaaaacaa806c0 187650521171648 07:19:01 GDB OUT x27 0xaaaacaa8ce88 187650521222792 07:19:01 GDB OUT x28 0x0 0 07:19:01 GDB OUT x29 0xffffe72cf590 281474560226704 07:19:01 GDB OUT x30 0xaaaaca9aaf50 187650520297296 07:19:01 GDB OUT sp 0xffffe72cf590 0xffffe72cf590 07:19:01 GDB OUT pc 0xffff895f4778 0xffff895f4778 07:19:01 GDB OUT cpsr 0x60001000 [ EL=0 C Z ] 07:19:01 GDB OUT fpsr 0x0 0 07:19:01 GDB OUT fpcr 0x0 0 07:19:01 GDB OUT Id Target Id Frame 07:19:01 GDB OUT * 1 process 2853364 "bash" 0x0000ffff895f4778 in waitpid () from /lib64/libc.so.6 07:19:01 GDB OUT 07:19:01 GDB OUT Thread 1 (process 2853364): 07:19:01 GDB OUT #0 0x0000ffff895f4778 in waitpid () from /lib64/libc.so.6 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #1 0x0000aaaaca9aaf50 in waitchld.isra () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #2 0x0000aaaaca9ac67c in wait_for () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #3 0x0000aaaaca99abfc in execute_command_internal () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #4 0x0000aaaaca999d6c in execute_command_internal () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #5 0x0000aaaaca99ae88 in execute_command () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #6 0x0000aaaaca998f00 in execute_command_internal () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #7 0x0000aaaaca999d6c in execute_command_internal () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #8 0x0000aaaaca99ae88 in execute_command () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #9 0x0000aaaaca998758 in execute_command_internal () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #10 0x0000aaaaca99ae88 in execute_command () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #11 0x0000aaaaca98297c in reader_loop () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT #12 0x0000aaaaca980f00 in main () 07:19:01 GDB OUT No symbol table info available. 07:19:01 GDB OUT Saved corefile core.2853364.2 07:19:01 GDB OUT A debugging session is active. 07:19:01 GDB OUT 07:19:01 GDB OUT Inferior 1 [process 2853364] will be detached. 07:19:01 GDB OUT 07:19:01 GDB OUT Quit anyway? (y or n) [answered Y; input not from terminal] 07:19:01 GDB OUT [Inferior 1 (process 2853364) detached] 07:19:01 ***[TEST INFO 2024/03/08 06:19:00] executing kill -ABRT 2853364*** 07:19:01 Time spent executing: 360483 milliseconds 07:19:01 Test result: FAILED 07:19:01 Output from test: 07:19:01 [OUT] start running script 07:19:01 [OUT] export GLIBC_TUNABLES=glibc.cpu.hwcaps=-XSAVEC,-XSAVE,-AVX2,-ERMS,-AVX,-AVX_Fast_Unaligned_Load 07:19:01 [OUT] export LD_BIND_NOT=on 07:19:01 [OUT] /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_OMR_testList_1/jdkbinary/j2sdk-image/bin/java -XX:+EnableCRIUSupport -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1 -cp /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_OMR_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criu.jar org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone 3 3 07:19:01 [ERR] /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_OMR_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh: line 41: 2853369 Killed $2 -XX:+EnableCRIUSupport $3 -cp "$1/criu.jar" $4 $5 $6 > testOutput 2>&1 07:19:01 07:19:01 ***[TEST INFO 2024/03/08 06:19:00] kill -ABRT signal sent*** 07:19:01 ***[TEST INFO 2024/03/08 06:19:00] ABRT completed*** 07:19:01 Output from test:

pshipton avatar Mar 11 '24 21:03 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.functional_aarch64_linux_Nightly_testList_1/645 cmdLineTester_criu_nonPortableRestore_5

pshipton avatar Mar 12 '24 14:03 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk22_j9_sanity.functional_aarch64_linux_Nightly_testList_0/34 cmdLineTester_criu_nonPortableRestore_5 Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone

pshipton avatar Mar 20 '24 12:03 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk22_j9_sanity.functional_aarch64_linux_Nightly_testList_1/48

pshipton avatar Apr 09 '24 19:04 pshipton

FIPS mode - JDK11 x86-64_linux_fips140_2(rhel8x86-rtp-rtfips4-1)

[2024-04-11T16:21:33.901Z] ---TEST RESULTS---
[2024-04-11T16:21:33.901Z] Number of PASSED tests: 63 out of 64
[2024-04-11T16:21:33.901Z] Number of FAILED tests: 1 out of 64
[2024-04-11T16:21:33.901Z] 
[2024-04-11T16:21:33.901Z] ---SUMMARY OF FAILED TESTS---
[2024-04-11T16:21:33.901Z] Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
[2024-04-11T16:21:33.901Z] -----------------------------
[2024-04-11T16:21:33.901Z] 
[2024-04-11T16:21:33.901Z] -----------------------------------
[2024-04-11T16:21:33.901Z] cmdLineTester_criu_nonPortableRestore_10_FAILED

JasonFengJ9 avatar Apr 12 '24 21:04 JasonFengJ9

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.functional_aarch64_linux_Nightly_testList_0/205 cmdLineTester_criu_nonPortableRestore_7

18:57:01  Testing: Create CRIU checkpoint image and restore three times - testDateScheduledBeforeCheckpointDone
18:57:01  Test start time: 2024/04/12 18:56:58 Eastern Standard Time
18:57:01  Running command: bash /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk21_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:gencon -Xgcthreads64 -XX:CheckpointGCThreads=1  -Xtrace:print={j9vm.684-696,j9vm.699,j9vm.717-747}" org.openj9.criu.TimeChangeTest testDateScheduledBeforeCheckpointDone 3 false false
18:57:01  Time spent starting: 3 milliseconds
19:02:00  ***[TEST INFO 2024/04/12 19:01:58] ProcessKiller detected a timeout after 300000 milliseconds!***

pshipton avatar Apr 16 '24 18:04 pshipton

https://openj9-jenkins.osuosl.org/job/Test_openjdk22_j9_sanity.functional_s390x_linux_Release_testList_1/10 cmdLineTester_criu_nonPortableRestore_5

10:37:19  Testing: Create CRIU checkpoint image and restore three times - testMillisDelayBeforeCheckpointDone
10:37:19  Test start time: 2024/04/21 14:37:18 Coordinated Universal Time
10:37:19  Running command: bash /home/jenkins/workspace/Test_openjdk22_j9_sanity.functional_s390x_linux_Release_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu/criuScript.sh /home/jenkins/workspace/Test_openjdk22_j9_sanity.functional_s390x_linux_Release_testList_1/aqa-tests/TKG/../../jvmtest/functional/cmdLineTests/criu /home/jenkins/workspace/Test_openjdk22_j9_sanity.functional_s390x_linux_Release_testList_1/jdkbinary/j2sdk-image/bin/java " -Xgcpolicy:optthruput " "org.openj9.criu.TimeChangeTest testMillisDelayBeforeCheckpointDone" 3 3 false false
10:37:19  Time spent starting: 1 milliseconds
10:42:23  ***[TEST INFO 2024/04/21 14:42:18] ProcessKiller detected a timeout after 300000 milliseconds!***
10:42:23  ***[TEST INFO 2024/04/21 14:42:18] executing /usr/bin/gdb -batch -x /tmp/debugger13881374502167143219.txt bash 744965***

pshipton avatar Apr 22 '24 16:04 pshipton