test-infra [Pytorch] There are 3 machines with long queues

Within the last 5 minutes, these machines had long queues (exact numbers may be out of date):

linux.aws.h100, 3 machines, 4.39 hours
linux.rocm.gpu.mi300.2, 45 machines, 4.16 hours
linux.s390x, 75 machines, 9.7 hours

Please look at the hud metrics page for more info.

May 27 '23 07:05 github-actions[bot]

These machines started queueing:

linux.12xlarge, 78 machines, 0.22 hours

May 27 '23 07:05 github-actions[bot]

These machines started queueing:

linux.12xlarge, 33 machines, 4.03 hours

May 27 '23 11:05 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 32 machines, 4.06 hours

May 27 '23 13:05 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 35 machines, 4.02 hours

May 28 '23 13:05 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 1 machines, 4.06 hours

May 28 '23 21:05 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 36 machines, 4.1 hours

May 29 '23 13:05 github-actions[bot]

These machines started queueing:

linux.12xlarge, 81 machines, 0.13 hours

May 29 '23 18:05 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 36 machines, 4.13 hours

May 30 '23 01:05 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 38 machines, 4.03 hours

May 30 '23 09:05 github-actions[bot]

These machines started queueing:

windows.4xlarge.nonephemeral, 93 machines, 0.34 hours

May 30 '23 15:05 github-actions[bot]

These machines started queueing:

linux.g5.4xlarge.nvidia.gpu, 112 machines, 0.14 hours

May 30 '23 21:05 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 19 machines, 4.1 hours

May 31 '23 05:05 github-actions[bot]

These machines started queueing:

linux.g5.4xlarge.nvidia.gpu, 77 machines, 0.25 hours

May 31 '23 16:05 github-actions[bot]

These machines started queueing:

linux.g5.4xlarge.nvidia.gpu, 120 machines, 0.26 hours

May 31 '23 18:05 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 1 machines, 4.04 hours

Jun 01 '23 19:06 github-actions[bot]

These machines started queueing:

linux.g5.4xlarge.nvidia.gpu, 84 machines, 0.14 hours

Jun 01 '23 19:06 github-actions[bot]

These machines started queueing:

linux.g5.4xlarge.nvidia.gpu, 125 machines, 0.22 hours

Jun 02 '23 19:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 49 machines, 4.02 hours

Jun 03 '23 21:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 46 machines, 4.07 hours

Jun 03 '23 22:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 14 machines, 4.06 hours

Jun 04 '23 14:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 1 machines, 4.08 hours

Jun 04 '23 17:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 47 machines, 4.13 hours

Jun 06 '23 00:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 8 machines, 4.02 hours

Jun 06 '23 14:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 26 machines, 4.01 hours

Jun 07 '23 00:06 github-actions[bot]

These machines started queueing:

linux.4xlarge, 1 machines, 4.08 hours

Jun 07 '23 03:06 github-actions[bot]

These machines started queueing:

linux.g5.4xlarge.nvidia.gpu, 125 machines, 0.19 hours

Jun 07 '23 18:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 48 machines, 4.06 hours

Jun 07 '23 21:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 44 machines, 4.05 hours

Jun 07 '23 21:06 github-actions[bot]

These machines started queueing:

linux.g5.4xlarge.nvidia.gpu, 78 machines, 0.18 hours

Jun 09 '23 03:06 github-actions[bot]

These machines started queueing:

windows.8xlarge.nvidia.gpu, 45 machines, 4.01 hours

Jun 09 '23 04:06 github-actions[bot]