OSUOSL hosted AIX machines down
Refs: https://github.com/nodejs/jenkins-alerts/issues/4503
test-osuosl-aix72-ppc64_be-4 went offline two days ago. Attempting to ssh into it, or any of the other OSUOSL hosted AIX machines results in a connection timeout.
Machines affected:
- release-osuosl-aix72-ppc64_be-1
- test-osuosl-aix72-ppc64_be-2
- test-osuosl-aix72-ppc64_be-3 (this machine is broken https://github.com/nodejs/build/issues/4035)
- test-osuosl-aix72-ppc64_be-4
Fortunately we also have a release machine and two test machines hosted on IBM Cloud which are unaffected so AIX CI is continuing to run.
Our other platforms hosted at OSUOSL (Linux on arm64 and ppc64le) are unaffected.
Support ticket 34690 raised with OSUOSL
-2 has not yet come back (although it was our intention to reinstall that one anyway so 🤷♂️ )
-4 has suffered the same fate as -3 had previously - a corrupted /home. fsck wasn't able to fix it so I've recreated the file systems on the same device, created /home/iojs with the appropriate agent.jar and .ssh/known_hosts.
-4 has run a job successfully, I'm just waiting for something to run on -3 before declaring success