rust-lang
CI: use alternative disks if available
A job failed! Check out the build log: (web) (plain enhanced) (plain)
Click to see the possible cause of the failure (guessed by this bot)
SCCACHE_BUCKET: rust-lang-ci-sccache2
SCCACHE_REGION: us-west-1
CACHE_DOMAIN: ci-caches.rust-lang.org
##[endgroup]
/mnt is not a mountpoint
Found unused block device /dev/nvme0n1, creating filesystem
mke2fs 1.47.0 (5-Feb-2023)
Discarding device blocks: 0/57671680 done
Creating filesystem with 57671680 4k blocks and 14417920 inodes
Filesystem UUID: f56e9224-fc94-4895-aafb-8739096e6810
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000, 7962624, 11239424, 20480000, 23887872
Allocating group tables: 0/1760 done
Writing inode tables: 0/1760 done
Creating journal (262144 blocks): done
Writing superblocks and filesystem accounting information: 0/1760 done
##[group]Run echo "[CI_PR_NUMBER=$num]"
echo "[CI_PR_NUMBER=$num]"
shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
---
tmpfs 1.6G 16K 1.6G 1% /run/user/1001
/dev/nvme0n1 216G 28K 205G 1% /home/runner/work/rust/rust/obj
biggest files in the working dir:
du: cannot read directory './obj/lost+found': Permission denied
438128 .
186648 ./tests
151512 ./tests/ui
107304 ./src
79232 ./src/tools
The job aarch64-gnu-llvm-20-2 failed! Check out the build log: (web) (plain enhanced) (plain)
Click to see the possible cause of the failure (guessed by this bot)
SCCACHE_BUCKET: rust-lang-ci-sccache2
SCCACHE_REGION: us-west-1
CACHE_DOMAIN: ci-caches.rust-lang.org
##[endgroup]
/mnt is not a mountpoint
Found unused block device /dev/nvme0n1, creating filesystem
mke2fs 1.47.0 (5-Feb-2023)
Discarding device blocks: 0/57671680 done
Creating filesystem with 57671680 4k blocks and 14417920 inodes
Filesystem UUID: cf4075a3-3e1b-4e6f-8e57-f6e1a6494570
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000, 7962624, 11239424, 20480000, 23887872
Allocating group tables: 0/1760 done
Writing inode tables: 0/1760 done
Creating journal (262144 blocks): done
Writing superblocks and filesystem accounting information: 0/1760 done
##[group]Run echo "[CI_PR_NUMBER=$num]"
echo "[CI_PR_NUMBER=$num]"
shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
---
expected success, got: exit status: 128
tidy [CI history]: FAIL
tidy: Skipping binary file check, read-only filesystem
tidy [style (src)]: /checkout/src/ci/scripts/free-disk-space-linux.sh:260: line longer than 100 chars
tidy [style (src)]: FAIL
tidy: The following checks failed: CI history, style (src)
Bootstrap failed while executing `--stage 2 test --skip tests --skip coverage-map --skip coverage-run --skip library --skip tidyselftest`
Command `/checkout/obj/build/aarch64-unknown-linux-gnu/stage1-tools-bin/rust-tidy /checkout /checkout/obj/build/aarch64-unknown-linux-gnu/stage0/bin/cargo /checkout/obj/build 4 npm` failed with exit code 1
Created at: src/bootstrap/src/core/build_steps/tool.rs:1549:23
Executed at: src/bootstrap/src/core/build_steps/test.rs:1280:29
Command has failed. Rerun with -v to see more details.
Build completed unsuccessfully in 0:00:47
local time: Sun Oct 26 17:11:58 UTC 2025
network time: Sun, 26 Oct 2025 17:11:58 GMT
##[error]Process completed with exit code 1.
##[group]Run echo "disk usage:"
The job aarch64-gnu-llvm-20-2 failed! Check out the build log: (web) (plain enhanced) (plain)
Click to see the possible cause of the failure (guessed by this bot)
SCCACHE_BUCKET: rust-lang-ci-sccache2
SCCACHE_REGION: us-west-1
CACHE_DOMAIN: ci-caches.rust-lang.org
##[endgroup]
/mnt is not a mountpoint
Found unused block device /dev/nvme0n1, creating filesystem
mke2fs 1.47.0 (5-Feb-2023)
Discarding device blocks: 0/57671680 done
Creating filesystem with 57671680 4k blocks and 14417920 inodes
Filesystem UUID: 1c67a774-42f0-434e-9661-492f8ef2003e
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000, 7962624, 11239424, 20480000, 23887872
Allocating group tables: 0/1760 done
Writing inode tables: 0/1760 done
Creating journal (262144 blocks): done
Writing superblocks and filesystem accounting information: 0/1760 done
##[group]Run echo "[CI_PR_NUMBER=$num]"
echo "[CI_PR_NUMBER=$num]"
shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
---
tidy [CI history]: FAIL
tidy: Skipping binary file check, read-only filesystem
tidy: The following check failed: CI history
Bootstrap failed while executing `--stage 2 test --skip tests --skip coverage-map --skip coverage-run --skip library --skip tidyselftest`
Command `/checkout/obj/build/aarch64-unknown-linux-gnu/stage1-tools-bin/rust-tidy /checkout /checkout/obj/build/aarch64-unknown-linux-gnu/stage0/bin/cargo /checkout/obj/build 4 npm` failed with exit code 1
Created at: src/bootstrap/src/core/build_steps/tool.rs:1549:23
Executed at: src/bootstrap/src/core/build_steps/test.rs:1280:29
Command has failed. Rerun with -v to see more details.
Build completed unsuccessfully in 0:00:44
local time: Sun Oct 26 17:36:34 UTC 2025
network time: Sun, 26 Oct 2025 17:36:34 GMT
##[error]Process completed with exit code 1.
##[group]Run echo "disk usage:"
The job aarch64-gnu-llvm-20-2 failed! Check out the build log: (web) (plain enhanced) (plain)
Click to see the possible cause of the failure (guessed by this bot)
SCCACHE_BUCKET: rust-lang-ci-sccache2
SCCACHE_REGION: us-west-1
CACHE_DOMAIN: ci-caches.rust-lang.org
##[endgroup]
/mnt is not a mountpoint
Found unused block device /dev/nvme0n1, creating filesystem
mke2fs 1.47.0 (5-Feb-2023)
Discarding device blocks: 0/57671680 done
Creating filesystem with 57671680 4k blocks and 14417920 inodes
Filesystem UUID: a43feacc-f349-4bda-88f6-1c78b0f462ac
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000, 7962624, 11239424, 20480000, 23887872
Allocating group tables: 0/1760 done
Writing inode tables: 0/1760 done
Creating journal (262144 blocks): done
Writing superblocks and filesystem accounting information: 0/1760 done
##[group]Run echo "[CI_PR_NUMBER=$num]"
echo "[CI_PR_NUMBER=$num]"
shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
---
tidy [CI history]: FAIL
tidy: Skipping binary file check, read-only filesystem
tidy: The following check failed: CI history
Bootstrap failed while executing `--stage 2 test --skip tests --skip coverage-map --skip coverage-run --skip library --skip tidyselftest`
Command `/checkout/obj/build/aarch64-unknown-linux-gnu/stage1-tools-bin/rust-tidy /checkout /checkout/obj/build/aarch64-unknown-linux-gnu/stage0/bin/cargo /checkout/obj/build 4 npm` failed with exit code 1
Created at: src/bootstrap/src/core/build_steps/tool.rs:1549:23
Executed at: src/bootstrap/src/core/build_steps/test.rs:1280:29
Command has failed. Rerun with -v to see more details.
Build completed unsuccessfully in 0:00:41
local time: Sun Oct 26 17:46:17 UTC 2025
network time: Sun, 26 Oct 2025 17:46:17 GMT
##[error]Process completed with exit code 1.
##[group]Run echo "disk usage:"
r? @marcoieni
rustbot has assigned @marcoieni. They will have a look at your PR within the next two weeks and either review your PR or reassign to another reviewer.
Use r? to explicitly pick a reviewer
OLD https://github.com/rust-lang/rust/actions/runs/18821126435 NEW https://github.com/rust-lang/rust/actions/runs/18821542169
I have no objections if this works as it seems faster than freeing up disk space 🙌 Let's make sure to try this on many jobs to prevent the auto build to fail. I would definitely mark this as rollup never.
I was also thinking: it's possible to run this github action step in the background, right? We would wait for it before the docker build start.
Just in case in the future we want to cleanup the disk space in the background 👍
I was also thinking: it's possible to run this github action step in the background, right? We would wait for it before the docker build start.
Kinda, but deleting currently takes many more minutes than it takes us to reach the docker step, so it doesn't save that much. I tried running both directory enumeration and deleting in parallel fashion and it looked like it maybe it cut down times, but the variance from run to run is so high that I'm not sure.
We could even run it in parallel with the docker step too since docker doesn't need the space immediately, but that would risk failures when deleting is really slow, like the 30 minutes I linked at the top.
So switching to a different drive is much faster, as long as it is available.
This PR was rebased onto a different main commit. Here's a range-diff highlighting what actually changed.
Rebasing is a normal part of keeping PRs up to date, so no action is needed—this note is just to help reviewers.
@bors try jobs=dist-x86_64-linux,x86_64-gnu-aux,dist-aarch64-linux,aarch64-gnu-llvm-20-1
:hourglass: Trying commit 32902a93d0ee4afbd05aec829dd068d2b6ef3d83 with merge 5c6810b50c625a46091b925cac0dc9ad4f2716f5…
To cancel the try build, run the command @bors try cancel.
Workflow: https://github.com/rust-lang/rust/actions/runs/19815474866
![rust-bors[bot] avatar](https://avatars.githubusercontent.com/in/278306?v=4 "Published by a pub.dev verified publisher"){kind=small}
A job failed! Check out the build log: (web) (plain enhanced) (plain)
Click to see the possible cause of the failure (guessed by this bot)
/dev/nvme0n1p1 372G 137G 236G 37% /etc/hosts
shm 512M 0 512M 0% /dev/shm
================================================================================
/mnt is not a mountpoint
Found unused block device /dev/nvme1n1, creating filesystem
mke2fs 1.46.5 (30-Dec-2021)
/dev/nvme1n1 is apparently in use by the system; will not make a filesystem here!
##[error]Process completed with exit code 1.
##[group]Run echo "disk usage:"
echo "disk usage:"
df -h
shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
:broken_heart: Test for 5c6810b50c625a46091b925cac0dc9ad4f2716f5 failed: CI. Failed jobs:
try - dist-x86_64-linux(web logs, extended logs)
sorry if it took me a lot of time to get back on this. Apparently there are some issues.
This PR was rebased onto a different main commit. Here's a range-diff highlighting what actually changed.
Rebasing is a normal part of keeping PRs up to date, so no action is needed—this note is just to help reviewers.
:hourglass: Trying commit 7d9597c55c864a2f37863c81af4d6d727f230013 with merge a9b4cb96bb93a2fff435083e4a5a8a0f9259e398…
To cancel the try build, run the command @bors try cancel.
Workflow: https://github.com/rust-lang/rust/actions/runs/19838491945
A job failed! Check out the build log: (web) (plain enhanced) (plain)
Click to see the possible cause of the failure (guessed by this bot)
/dev/nvme0n1p1 372G 137G 236G 37% /etc/hosts
shm 512M 0 512M 0% /dev/shm
================================================================================
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
nvme1n1 259:0 0 32G 0 disk
nvme0n1 259:1 0 372G 0 disk
├─nvme0n1p1 259:2 0 372G 0 part /var/lib/docker
│ /etc/hosts
│ /etc/hostname
│ /etc/resolv.conf
│ /codebuild/bootstrap
│ /codebuild/readonly
│ /codebuild/output
└─nvme0n1p128 259:3 0 1M 0 part
overlay on / type overlay (rw,relatime,lowerdir=/var/lib/docker/overlay2/l/FNBCH3HGA5EMX3HKKBHLA3MJ5P:/var/lib/docker/overlay2/l/M7MLZ5XLGQDBO3QSO7JUGDKCIT:/var/lib/docker/overlay2/l/O24CP3DE5QMBZE5I3OM2XTF4OT:/var/lib/docker/overlay2/l/DGUR3MH3QQYMBT2NIV57VX5L52:/var/lib/docker/overlay2/l/HORBZT5THYCEDIK227GR6MTEOT:/var/lib/docker/overlay2/l/PLLACJVYV7VZY7O2HFMU2XNMV4:/var/lib/docker/overlay2/l/RGZ25DTKJ4ND2OWB3EDH3MY4N5:/var/lib/docker/overlay2/l/3S6HW6EHDHXYLFSRSJJGTPWLYU:/var/lib/docker/overlay2/l/FV33CHA6O5M7AC6WK73NRV2HSW:/var/lib/docker/overlay2/l/TNKIHMVIRBR2VG364N4RJZ4ZYG:/var/lib/docker/overlay2/l/IGAUAU7WJUXB365TSZWZ3Y2Q37:/var/lib/docker/overlay2/l/OT2A6SHVJDLEFOBYMITWTB5NMO:/var/lib/docker/overlay2/l/GX2ZKERVEZ546KZW4NB3VXY2EZ:/var/lib/docker/overlay2/l/7RVOC43IZZR6NNMYUALP6X3LLT:/var/lib/docker/overlay2/l/I3O6ADX3CKXPYWBMSL45PFZSB3:/var/lib/docker/overlay2/l/WBLQAJLRU2KJWMEPTH3Q2GS2ML:/var/lib/docker/overlay2/l/KOAVNRHAXKVPGWWSTEZLHHKRRS:/var/lib/docker/overlay2/l/UPPO5625NEULO3LTANKUJWZ3UP:/var/lib/docker/overlay2/l/PXMHVZNL2KUH76IVSXDPIXNOBE:/var/lib/docker/overlay2/l/4ZOWYYR55WF73FF5KXNGKJXKNN:/var/lib/docker/overlay2/l/STN7EUDMRMLXMTZMOKPYHLODFN:/var/lib/docker/overlay2/l/XLXDLSWAOVZDOQTCZ4MFDROCZ4:/var/lib/docker/overlay2/l/NQZVDN54EB4DKEMZ7HXWF4A3K4:/var/lib/docker/overlay2/l/LQVGK343SWSAC7BEB3Q6OO773J:/var/lib/docker/overlay2/l/SBTCZRIS4ICU7TVMPU5X3TO4SK:/var/lib/docker/overlay2/l/WYI7HHBZ67S3FA6ITFM3IJ2UMX:/var/lib/docker/overlay2/l/TCNNQPE3NH6YTZ6FPB5LCDO43K:/var/lib/docker/overlay2/l/AXDV5EEQGJYLOTIJU7JLTAB5WG:/var/lib/docker/overlay2/l/AWI6S26HGVLZ3YIGEBRK4T7L2A:/var/lib/docker/overlay2/l/P7FWCEWYWOWRXRDSQOTTMVNFZD:/var/lib/docker/overlay2/l/TWIZPGSXUHUH47NJTHBNZ6MHUK:/var/lib/docker/overlay2/l/FSEPEMVURFE3IKV2IJBICSEDN7:/var/lib/docker/overlay2/l/7SOHVMKIRLHBNFCHJIQF3F7JML:/var/lib/docker/overlay2/l/7K64EPD2U4DHCHJXQ2QEGQ5CPP:/var/lib/docker/overlay2/l/JC4KRERGEU4IFJQKNFF2RKNNZE:/var/lib/docker/overlay2/l/D3RCKCJEWNP7NOAXM4LGOJZUN5:/var/lib/docker/overlay2/l/3QGYLGZZMXXX4ATGKA4OSM4AE4:/var/lib/docker/overlay2/l/EN5MBYUQJCS5N63T6B5THN46JR:/var/lib/docker/overlay2/l/PFGFTOIHA2TMDPMMECBYRITW22:/var/lib/docker/overlay2/l/KS3H4CBWRZATCLAL6SU4OEW2MU:/var/lib/docker/overlay2/l/32KR3CIQEFXNVLUFEU4VFYAVII:/var/lib/docker/overlay2/l/ZDWMH3ZXO75L4TUJWEZENWG6NW:/var/lib/docker/overlay2/l/7KFGYI4OWIMELU7LLULENWXCHL:/var/lib/docker/overlay2/l/2V7QXIHCX44J72V3IWLCEG77MV:/var/lib/docker/overlay2/l/6TTWZG7JPDLIG5BNRR4OKRVQNE:/var/lib/docker/overlay2/l/DLC54MCNHZ37UVUTG4X62OAOZM:/var/lib/docker/overlay2/l/M3TJQZRH4EKJZ6LT4EHQXXVWC5:/var/lib/docker/overlay2/l/WG5LT5VICHBNVPY7CIHSURFXFU:/var/lib/docker/overlay2/l/R3ZIPYDQZXPO3CXXEI4P7RXZBU:/var/lib/docker/overlay2/l/QDZEU34S65IKEFVYBUZ3OQQ476:/var/lib/docker/overlay2/l/LZTJKI44WGK7MK4KZ6WPXVHVBV:/var/lib/docker/overlay2/l/U3FPONTR6N2KB7ZDQBHLVCZRE3:/var/lib/docker/overlay2/l/XRAYFOD52TVEM3O5F5HA7JG5HX:/var/lib/docker/overlay2/l/DAEDF7FKUAIJRE5JQ5YNFFV5FT:/var/lib/docker/overlay2/l/OHXV53HPAKUNWZCEODIYBPLQJI:/var/lib/docker/overlay2/l/F2COSBJS7RWFPAEQGNOQ2RKBBB:/var/lib/docker/overlay2/l/PIDFYMSIJR7ELCRM4MJZTWU3LX:/var/lib/docker/overlay2/l/EQTLN2GWI4TZUUQ2UGXFLN7W2Z:/var/lib/docker/overlay2/l/R6PBPDIWWPIUDF4OQQAUCL6IJU:/var/lib/docker/overlay2/l/W3ZQPED26O2TIO67DT4XBOW74A,upperdir=/var/lib/docker/overlay2/0a7a2b1972cb25dd62e3d77d5fde0d28ceb40e0a0938a3f3ee1a1fa57984ab7e/diff,workdir=/var/lib/docker/overlay2/0a7a2b1972cb25dd62e3d77d5fde0d28ceb40e0a0938a3f3ee1a1fa57984ab7e/work)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev type tmpfs (rw,nosuid,size=65536k,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=666)
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /sys/fs/cgroup type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
/dev/nvme0n1p1 on /codebuild/output type xfs (rw,noatime,attr2,inode64,noquota)
/dev/nvme0n1p1 on /codebuild/readonly type xfs (rw,noatime,attr2,inode64,noquota)
/dev/nvme0n1p1 on /codebuild/bootstrap type xfs (ro,noatime,attr2,inode64,noquota)
/dev/nvme0n1p1 on /etc/resolv.conf type xfs (rw,noatime,attr2,inode64,noquota)
/dev/nvme0n1p1 on /etc/hostname type xfs (rw,noatime,attr2,inode64,noquota)
/dev/nvme0n1p1 on /etc/hosts type xfs (rw,noatime,attr2,inode64,noquota)
shm on /dev/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=524288k)
/dev/nvme0n1p1 on /var/lib/docker type xfs (rw,noatime,attr2,inode64,noquota)
/mnt is not a mountpoint
Found unused block device /dev/nvme1n1, creating filesystem
mke2fs 1.46.5 (30-Dec-2021)
/dev/nvme1n1 is apparently in use by the system; will not make a filesystem here!
##[error]Process completed with exit code 1.
##[group]Run echo "disk usage:"
echo "disk usage:"
df -h
shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
:broken_heart: Test for a9b4cb96bb93a2fff435083e4a5a8a0f9259e398 failed: CI. Failed jobs:
try - dist-x86_64-linux(web logs, extended logs)
Ah the codebuild runners are running inside a container, I assumed it would be the host. Doing filesystem shenanigans inside a container isn't a good idea. Then I'll remove that section. Those boxes have enough disk space anyway, we can just skip cleanup.
Then I'll remove that section.
... but it did work on the aarch64 runners, so we need it after all.
@bors try jobs=dist-x86_64-linux,x86_64-gnu-aux,dist-aarch64-linux,aarch64-gnu-llvm-20-1
:hourglass: Trying commit 183f29bc3bfbdb9cc8bd5154f7f02730a8a959ad with merge bf5291af779bad021096c90214bc0ee1ad9a138d…
To cancel the try build, run the command @bors try cancel.
Workflow: https://github.com/rust-lang/rust/actions/runs/19991553331
:broken_heart: Test for bf5291af779bad021096c90214bc0ee1ad9a138d failed: CI. Failed jobs:
try - x86_64-gnu-aux(web logs, extended logs)
The job x86_64-gnu-aux failed! Check out the build log: (web) (plain enhanced) (plain)
Click to see the possible cause of the failure (guessed by this bot)
/dev/sda1 74G 4.1G 66G 6% /mnt
tmpfs 1.6G 12K 1.6G 1% /run/user/1001
================================================================================
/mnt is a mountpoint
Sufficient space available on /dev/sda1 mounted at /mnt
##[group]Run src/ci/scripts/setup-environment.sh
src/ci/scripts/setup-environment.sh
shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}