build icon indicating copy to clipboard operation
build copied to clipboard

OSUOSL hosted AIX machines down

Open richardlau opened this issue 2 weeks ago • 3 comments

Refs: https://github.com/nodejs/jenkins-alerts/issues/4503

test-osuosl-aix72-ppc64_be-4 went offline two days ago. Attempting to ssh into it, or any of the other OSUOSL hosted AIX machines results in a connection timeout.

Machines affected:

  • release-osuosl-aix72-ppc64_be-1
  • test-osuosl-aix72-ppc64_be-2
  • test-osuosl-aix72-ppc64_be-3 (this machine is broken https://github.com/nodejs/build/issues/4035)
  • test-osuosl-aix72-ppc64_be-4

Fortunately we also have a release machine and two test machines hosted on IBM Cloud which are unaffected so AIX CI is continuing to run.

richardlau avatar Dec 04 '25 12:12 richardlau

Our other platforms hosted at OSUOSL (Linux on arm64 and ppc64le) are unaffected.

richardlau avatar Dec 04 '25 12:12 richardlau

Support ticket 34690 raised with OSUOSL

sxa avatar Dec 04 '25 13:12 sxa

-2 has not yet come back (although it was our intention to reinstall that one anyway so 🤷‍♂️ ) -4 has suffered the same fate as -3 had previously - a corrupted /home. fsck wasn't able to fix it so I've recreated the file systems on the same device, created /home/iojs with the appropriate agent.jar and .ssh/known_hosts.

-4 has run a job successfully, I'm just waiting for something to run on -3 before declaring success

sxa avatar Dec 05 '25 18:12 sxa