aqa-tests icon indicating copy to clipboard operation
aqa-tests copied to clipboard

Added system_lib for system prestage jars

Open annaibm opened this issue 1 year ago • 3 comments

  • Prestage system test prequisities to system_lib

related: https://github.com/adoptium/aqa-tests/issues/4912

annaibm avatar Apr 18 '24 13:04 annaibm

Grinder links: https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/39879/consoleFull https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/39882/console https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/39906/consoleFull

annaibm avatar Apr 18 '24 13:04 annaibm

pre-stage jars are not used. asm.jar still got downloaded to /home/jenkins/workspace/Grinder/aqa-tests/systemtest_prereqs/asm/:

00:08:53.766  configure-asm:
00:08:53.766       [echo] Executing macro download-file
00:08:53.766       [echo] File to download: https://repository.ow2.org/nexus/content/repositories/releases/org/ow2/asm/asm/9.0/asm-9.0.jar
00:08:53.766       [echo] Destination: /home/jenkins/workspace/Grinder/aqa-tests/systemtest_prereqs/asm/asm.jar
00:08:53.766       [echo] Download tool: curl
00:08:53.766      [mkdir] Created dir: /home/jenkins/workspace/Grinder/aqa-tests/systemtest_prereqs/asm
00:08:53.766       [exec]   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
00:08:53.766       [exec]                                  Dload  Upload   Total   Spent    Left  Speed
00:08:53.766       [exec] 
00:08:54.639       [exec]   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0100  118k  100  118k    0     0   114k      0  0:00:01  0:00:01 --:--:--  114k
00:08:54.639  

I suspect that we need to update the reference in system test repo.

llxia avatar Apr 18 '24 17:04 llxia

Try change this line https://github.com/adoptium/aqa-tests/blob/3ae4045110a57544756581a9634ce8cc2043cadb/system/system.mk#L77

llxia avatar Apr 18 '24 18:04 llxia

Grinder links: https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/40745/ -linux https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/40746/ -windows https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/40768/ -mac

annaibm avatar May 21 '24 19:05 annaibm

@annaibm can you point me to the code of creating systemtest_prereqs dir if it does not exist?

llxia avatar May 22 '24 19:05 llxia

@annaibm can you point me to the code of creating systemtest_prereqs dir if it does not exist?

@llxia I have reverted the code to include copy of systemtest_prereqs as in https://github.com/annaibm/aqa-tests/blob/test_systemtest/system/common.xml#L339C3-L341C10.

annaibm avatar May 22 '24 19:05 annaibm

The current PR does not have The systemtest-prereqs directory could not be found. error locally?

llxia avatar May 22 '24 20:05 llxia

The current PR does not have The systemtest-prereqs directory could not be found. error locally?

No, it is getting processed as below

TESTING:
STF 08:58:26.042 - =========================   S T F   =========================
systemtest-prereqs has been processed, and set to: /home/jenkins/workspace/Grinder/jvmtest/system/systemtest_prereqsRetrieving amount of free space on drive containing /home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/output_17163935052911/MiniMix_5m_0
There is 203270 Mb free

annaibm avatar May 22 '24 20:05 annaibm

Grinder links: https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/40841/

annaibm avatar May 24 '24 20:05 annaibm

https://github.com/adoptium/aqa-tests/blob/a6dbf7c16f535f74c0802d0340c5acf6333217ae/buildenv/jenkins/JenkinsfileBase#L679-L689 should be removed.

llxia avatar May 27 '24 15:05 llxia

Grinder links: Sytem test https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/40892/ https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/40894/ (windows) non -system test: https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/40893/ Local test passed:

LT  08:34:18.459 - Test stopped due to reaching runtime limit
LT  08:34:18.459 - Load test completed
LT  08:34:18.461 -   Ran     : 57047
LT  08:34:18.461 -   Passed  : 57047
LT  08:34:18.461 -   Failed  : 0
LT  08:34:18.461 -   Result  : PASSED
STF 08:34:19.009 - Monitoring Report Summary:
STF 08:34:19.009 -   o Process LT  ended with the expected exit code (0)
STF 08:34:19.009 - EXECUTE stage completed
STF 08:34:19.509 - 
STF 08:34:19.509 - ====================   T E A R D O W N   ====================
STF 08:34:19.509 - Running teardown: perl /home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/output_17169097929139/MiniMix_5m_1/20240528-082852-MixedLoadTest/tearDown.pl
STF 08:34:19.601 - TEARDOWN stage completed
STF 08:34:19.609 - 
STF 08:34:19.609 - =====================   R E S U L T S   =====================
STF 08:34:19.609 - Stage results:
STF 08:34:19.609 -   setUp:     pass
STF 08:34:19.609 -   execute:   pass
STF 08:34:19.609 -   teardown:  pass
STF 08:34:19.609 - 
STF 08:34:19.609 - Overall result: PASSED
-----------------------------------
MiniMix_5m_1_PASSED
-----------------------------------

TEST TEARDOWN:

Attempting to destroy all caches in cacheDir /home/jenkins/.cache/javasharedresources/

JVMSHRC806I Compressed references persistent shared cache "sharedcc_jenkins" has been destroyed. Use option -Xnocompressedrefs if you want to destroy a non-compressed references cache.
JVMSHRC807I Non-compressed references persistent shared cache "sharedcc_jenkins" has been destroyed. Use option -Xcompressedrefs if you want to destroy a compressed references cache.
JVMSHRC005I No shared class caches available
cache cleanup done
MiniMix_5m_1 Finish Time: Tue May 28 08:34:19 2024 Epoch Time (ms): 1716910459719

===============================================
Running test MiniMix_5m_2 ...
===============================================
MiniMix_5m_2 Start Time: Tue May 28 08:34:19 2024 Epoch Time (ms): 1716910459781
Skipped due to jvm options ( ) => MiniMix_5m_2_SKIPPED
MiniMix_5m_2 Finish Time: Tue May 28 08:34:19 2024 Epoch Time (ms): 1716910459809
make[4]: Leaving directory '/home/jenkins/workspace/Grinder/aqa-tests/system/otherLoadTest'
make[3]: Leaving directory '/home/jenkins/workspace/Grinder/aqa-tests/system'
make[2]: Leaving directory '/home/jenkins/workspace/Grinder/aqa-tests'


All tests finished, run result summary:
cd "/home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/scripts"; \
perl "resultsSum.pl" --failuremk="/home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/failedtargets.mk" --resultFile="/home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/output_17169097929139/TestTargetResult" --platFile="/home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/resources/buildPlatformMap.properties" --diagnostic=failure --jdkVersion=17 --jdkImpl=openj9 --jdkVendor="eclipse" --spec=linux_x86-64 --buildList=system --customTarget="" --testTarget=MiniMix_5m --tapPath=/home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/output_17169097929139/ --tapName= --comment=""


TEST TARGETS SUMMARY
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
PASSED test targets:
	MiniMix_5m_0
	MiniMix_5m_1

TOTAL: 3   EXECUTED: 2   PASSED: 2   FAILED: 0   DISABLED: 0   SKIPPED: 1
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

ALL TESTS PASSED

_MiniMix_5m done

annaibm avatar May 28 '24 15:05 annaibm

This PR has to be merged with https://github.com/adoptium/TKG/pull/533 and https://github.com/adoptium/STF/pull/135

llxia avatar May 29 '24 18:05 llxia