CCF
CCF copied to clipboard
microsoft
CI failure observed
This CI run unexpectedly failed: https://github.com/microsoft/CCF/pull/5778/checks?check_run_id=18090858685. Rerunning it fixed it
As did https://github.com/microsoft/CCF/pull/5790/checks?check_run_id=18092504269
The first one is a disk full error, we'd added local disk to the 1ES executors to take care of this, but they do not seem to be mounted in the expected location anymore. As a workaround, I've shorted the max duration for executors to 1 day (down from 7), which will hopefully address the issue.
The second issue is an unfortunate byproduct of a build being canceled during the run of the ctest partitions step, which happens as root to be able to update iptables. When this happens, even the blocks that are normally executed on failure to clean up are not run, leaving a bunch of files owned by root under build.
One solution would be a pre-emptive cleanup step run as root, another would be to switch to a way to do network chaos testing without elevating.
The space issue has been addressed by adding an extra disk, and the permission issue will no longer happen on GHA because the whole container is run as root.