mystikos
mystikos copied to clipboard
deislabs
Issue to track flaky tests seen in PR pipeline
Please list failures you have seen in the PR pipeline here. Please also add a link to the run that showed the failure
| test | first seen | last seen | count | pipeline link |
|---|---|---|---|---|
| tests/ltp.sgx/accept02/failed | Sep 23 2021 | - | 1 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FPR-MBP/detail/PR-795/8/pipeline |
| tests/glibc.sgx/tst-barrier2/failed | Sep 23 2021 | - | 1 | locally |
| cpprestsdk failed | 3/1/2022 | 3/1/2022 | 1 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FStandalone-Pipelines%2FSolutions-Tests-Pipeline/detail/Solutions-Tests-Pipeline/2623/pipeline |
| cpython test_imaplib | 3/1/2022 | 3/1/2022 | 1 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FStandalone-Pipelines%2FUnit-Tests-Pipeline/detail/Unit-Tests-Pipeline/2714/pipeline |
| /app/llvm-project/libcxx/test/std/thread/futures/futures.unique_future/move_ctor.pass.cpp | Approx. 3/24/2022 | 3/28/2022 | 2 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FStandalone-Pipelines%2FUnit-Tests-Pipeline/detail/Unit-Tests-Pipeline/3850/pipeline/ |
| azure-sdk-for-cpp/Context.ThrowIfCancelled | 4/4/2022 | 4/7/2022 | 2 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FStandalone-Pipelines%2FAzure-SDK-Tests-Pipeline/detail/Azure-SDK-Tests-Pipeline/1412/pipeline/ |
| azure-sdk-for-python timedout at 87% | 4/4/2022 | 4/4/2022 | 1 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FStandalone-Pipelines%2FAzure-SDK-Tests-Pipeline/detail/Azure-SDK-Tests-Pipeline/1412/pipeline/ |
| mkcpio timedout | 4/21/2022 | 4/21/2022 | 1 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FStandalone-Pipelines%2FUnit-Tests-Pipeline/detail/Unit-Tests-Pipeline/4401/pipeline |
| wait_for.pass.cpp | 5/12/2022 | 5/12/2022 | 1 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FStandalone-Pipelines%2FUnit-Tests-Pipeline/detail/Unit-Tests-Pipeline/4875/pipeline/ |
| azure-sdk-for-cpp Operation.PollUntilDone | 5/12/2022 | 5/12/2022 | 1 | https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FStandalone-Pipelines%2FAzure-SDK-Tests-Pipeline/detail/Azure-SDK-Tests-Pipeline/1756/pipeline/ |
- failed: tests/ltp.sgx/accept02/failed
- failed: tests/glibc.sgx/tst-barrier2/failed
Source: https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FPR-MBP/detail/PR-795/8/pipeline
Running locally: failed: tests/ltp.sgx/setregid03/failed failed: tests/ltp.sgx/accept4_01/failed
Nightly pipeline failed for the below test: https://openenclave.visualstudio.com/ACC-Services/_build/results?buildId=11288&view=logs&j=ab477ad6-9781-5b54-82ca-a0141b26726e&t=a1e294d4-8895-5a45-41ff-022cede0621b failed: tests/clock.linux/cpuclocks failed: --memory-size=16m/failed
Build failures that are occasionally seen in Jenkins were root caused to be due to the following:
make[5]: Entering directory '/home/oeadmin/workspace/Mystikos/Nightly-Pipeline/tests/libcxx2'
/home/oeadmin/workspace/Mystikos/Nightly-Pipeline/build/bin/myst mkext2 /home/oeadmin/workspace/Mystikos/Nightly-Pipeline/tests/libcxx2/appdir /home/oeadmin/workspace/Mystikos/Nightly-Pipeline/tests/libcxx2/rootfs
sudo groupadd -f -g 100705 grp705
groupadd: cannot lock /etc/group; try again later.
Makefile:108: recipe for target 'add_host_users_and_groups' failed
make[6]: *** [add_host_users_and_groups] Error 10
make[6]: Leaving directory '/home/oeadmin/workspace/Mystikos/Nightly-Pipeline/tests/ltp'
Makefile:62: recipe for target 'build' failed
https://oe-jenkins-dev.westeurope.cloudapp.azure.com/job/Mystikos/job/Nightly-Pipeline/98/
Fix proposed here: https://github.com/deislabs/mystikos/pull/883
tests/ltp.sgx/fcntl04
runtest[start]: /usr/bin/timeout 120 /usr/bin/time -f %e --quiet -o /tmp/tmp.vvjkB8JEuP /home/oeadmin/workspace/Mystikos_PR-MBP_PR-881/build/bin/myst exec-sgx --app-config-path config.json ext2fs /ltp/testcases/kernel/syscalls/pread/pread02
runtest[finish]: /usr/bin/timeout 120 /usr/bin/time -f %e --quiet -o /tmp/tmp.nfdOcvGjW9 /home/oeadmin/workspace/Mystikos_PR-MBP_PR-881/build/bin/myst exec-sgx --app-config-path config.json --host-to-enc-uid-map 0:0,1:1,2:2,65534:65534,100700:700,100702:702,100703:703,1001000:1000 --host-to-enc-gid-map 0:0,1:1,2:2,65534:65534,100701:701,100704:704,100705:705,1001000:1000 hostfs /ltp/testcases/kernel/syscalls/fcntl/fcntl04
[31m timedout (tests/ltp.sgx/fcntl04)[39m
https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FPR-MBP/detail/PR-881/2/pipeline/
https://oe-jenkins-dev.westeurope.cloudapp.azure.com/blue/organizations/jenkins/Mystikos%2FNightly-Pipeline/detail/Nightly-Pipeline/115/pipeline#step-55-log-3410 - Seeing
failed: tests/ltp.sgx/pause02/failed