software-layer
software-layer copied to clipboard
Published
20 hours ago •
EESSI
EESSI
{2025.06}[2025a] Mesa 25.1.3
22 out of 69 required modules missing:
* Bison/3.8.2-GCCcore-14.2.0 (Bison-3.8.2-GCCcore-14.2.0.eb)
* Mako/1.3.10-GCCcore-14.2.0 (Mako-1.3.10-GCCcore-14.2.0.eb)
* Cython/3.1.1-GCCcore-14.2.0 (Cython-3.1.1-GCCcore-14.2.0.eb)
* libyaml/0.2.5-GCCcore-14.2.0 (libyaml-0.2.5-GCCcore-14.2.0.eb)
* libunwind/1.8.1-GCCcore-14.2.0 (libunwind-1.8.1-GCCcore-14.2.0.eb)
* Doxygen/1.14.0-GCCcore-14.2.0 (Doxygen-1.14.0-GCCcore-14.2.0.eb)
* glslang-SPIRV/15.3.0-GCCcore-14.2.0 (glslang-SPIRV-15.3.0-GCCcore-14.2.0.eb)
* Wayland/1.23.92-GCCcore-14.2.0 (Wayland-1.23.92-GCCcore-14.2.0.eb)
* psutil/7.0.0-GCCcore-14.2.0 (psutil-7.0.0-GCCcore-14.2.0.eb)
* lit/18.1.8-GCCcore-14.2.0 (lit-18.1.8-GCCcore-14.2.0.eb)
* libpng/1.6.48-GCCcore-14.2.0 (libpng-1.6.48-GCCcore-14.2.0.eb)
* Brotli/1.1.0-GCCcore-14.2.0 (Brotli-1.1.0-GCCcore-14.2.0.eb)
* GMP/6.3.0-GCCcore-14.2.0 (GMP-6.3.0-GCCcore-14.2.0.eb)
* freetype/2.13.3-GCCcore-14.2.0 (freetype-2.13.3-GCCcore-14.2.0.eb)
* Z3/4.13.4-GCCcore-14.2.0 (Z3-4.13.4-GCCcore-14.2.0.eb)
* LLVM/20.1.7-GCCcore-14.2.0 (LLVM-20.1.7-GCCcore-14.2.0.eb)
* fontconfig/2.16.2-GCCcore-14.2.0 (fontconfig-2.16.2-GCCcore-14.2.0.eb)
* X11/20250521-GCCcore-14.2.0 (X11-20250521-GCCcore-14.2.0.eb)
* libdrm/2.4.125-GCCcore-14.2.0 (libdrm-2.4.125-GCCcore-14.2.0.eb)
* libglvnd/1.7.0-GCCcore-14.2.0 (libglvnd-1.7.0-GCCcore-14.2.0.eb)
* PyYAML/6.0.2-GCCcore-14.2.0 (PyYAML-6.0.2-GCCcore-14.2.0.eb)
* Mesa/25.1.3-GCCcore-14.2.0 (Mesa-25.1.3-GCCcore-14.2.0.eb)
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2 bot: build repo:eessi.io-2025.06-software instance:eessi-bot-jsc for:arch=aarch64/nvidia/grace
New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.10/pr_1257/98421
| date | job status | comment |
|---|---|---|
| Oct 22 13:37:37 UTC 2025 | submitted | job id 98421 awaits release by job manager |
| Oct 22 13:38:32 UTC 2025 | released | job awaits launch by Slurm scheduler |
| Oct 22 13:43:44 UTC 2025 | running | job 98421 is running |
| Oct 22 14:17:02 UTC 2025 | finished | :cry: FAILURE (click triangle for details)
|
| Oct 22 14:17:02 UTC 2025 | test result | :grin: SUCCESS (click triangle for details)
|
![eessi-bot-aws[bot] avatar](https://avatars.githubusercontent.com/in/1314134?v=4 "Published by a pub.dev verified publisher"){kind=small}
New job on instance eessi-bot-jsc for repository eessi.io-2025.06-software
Building on: nvidia-grace
Building for: aarch64/nvidia/grace
Job dir: /p/project1/ceasybuilders/eessibot/jobs/2025.10/pr_1257/14134332
| date | job status | comment |
|---|---|---|
| Oct 22 13:37:38 UTC 2025 | submitted | job id 14134332 awaits release by job manager |
| Oct 22 13:37:56 UTC 2025 | released | job awaits launch by Slurm scheduler |
| Oct 22 13:39:04 UTC 2025 | running | job 14134332 is running |
| Oct 22 14:03:38 UTC 2025 | finished | :cry: FAILURE (click triangle for details)
|
| Oct 22 14:03:38 UTC 2025 | test result | :grin: SUCCESS (click triangle for details)
|
![eessi-bot-jsc[bot] avatar](https://avatars.githubusercontent.com/in/1399569?v=4 "Published by a pub.dev verified publisher"){kind=small}
X11 failure:
== FAILED: Installation ended unsuccessfully: Couldn't find file libXau-1.0.12.tar.gz anywhere, and downloading it didn't work either...
https://xorg.freedesktop.org/archive/individual/lib/libXau-1.0.12.tar.gz works fine for me though, maybe it was a short outage? Let's try again.
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.10/pr_1257/98422
| date | job status | comment |
|---|---|---|
| Oct 22 14:22:52 UTC 2025 | submitted | job id 98422 awaits release by job manager |
| Oct 22 14:23:09 UTC 2025 | released | job awaits launch by Slurm scheduler |
| Oct 22 14:24:13 UTC 2025 | running | job 98422 is running |
| Oct 22 14:57:05 UTC 2025 | finished | :cry: FAILURE (click triangle for details)
|
| Oct 22 14:57:05 UTC 2025 | test result | :grin: SUCCESS (click triangle for details)
|
Hmm, same failure, and the detailed log shows:
== 2025-10-22 14:51:10,176 filetools.py:923 WARNING IOError occurred while trying to download https://xorg.freedesktop.org/archive/individual/lib/libXau-1.0.12.tar.gz to /project/def-u
sers/bot/shared/easybuild/sources/x/X11/libXau-1.0.12.tar.gz: <urlopen error _ssl.c:1015: The handshake operation timed out>
Downloaded the file manually to the sources dir.
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.10/pr_1257/98423
| date | job status | comment |
|---|---|---|
| Oct 22 15:58:13 UTC 2025 | submitted | job id 98423 awaits release by job manager |
| Oct 22 15:59:14 UTC 2025 | released | job awaits launch by Slurm scheduler |
| Oct 22 16:05:16 UTC 2025 | running | job 98423 is running |
| Oct 22 16:37:58 UTC 2025 | finished | :cry: FAILURE (click triangle for details)
|
| Oct 22 16:37:58 UTC 2025 | test result | :grin: SUCCESS (click triangle for details)
|
Now the next X11 source tarball has the same issue, maybe it's better to look into this a bit more and find out why these downloads (suddenly?) don't work anymore.
The connection setup was sometimes really slow for me too (>10 sec, which I think is the timeout threshold for Python), but while I was debugging it, the problem suddenly seemed to disappear. Let me try again...
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.10/pr_1257/98671
| date | job status | comment |
|---|---|---|
| Oct 23 10:09:35 UTC 2025 | submitted | job id 98671 awaits release by job manager |
| Oct 23 10:09:55 UTC 2025 | released | job awaits launch by Slurm scheduler |
| Oct 23 10:10:57 UTC 2025 | running | job 98671 is running |
| Oct 23 10:41:35 UTC 2025 | finished | :cry: FAILURE (click triangle for details)
|
| Oct 23 10:41:35 UTC 2025 | test result | :grin: SUCCESS (click triangle for details)
|
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-jsc for:arch=aarch64/nvidia/grace
New job on instance eessi-bot-jsc for repository eessi.io-2025.06-software
Building on: nvidia-grace
Building for: aarch64/nvidia/grace
Job dir: /p/project1/ceasybuilders/eessibot/jobs/2025.10/pr_1257/14138862
| date | job status | comment |
|---|---|---|
| Oct 23 11:31:51 UTC 2025 | submitted | job id 14138862 awaits release by job manager |
| Oct 23 11:32:00 UTC 2025 | released | job awaits launch by Slurm scheduler |
| Oct 23 11:46:06 UTC 2025 | running | job 14138862 is running |
| Oct 23 12:25:20 UTC 2025 | finished | :cry: FAILURE (click triangle for details)
|
| Oct 23 12:25:20 UTC 2025 | test result | :grin: SUCCESS (click triangle for details)
|
Now X11 succeeded, but downloading the libdrm tarball failed. That one is also hosted on freedesktop.org though, i.e. the same one that also has the X11 tarballs.
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-jsc for:arch=aarch64/nvidia/grace
New job on instance eessi-bot-jsc for repository eessi.io-2025.06-software
Building on: nvidia-grace
Building for: aarch64/nvidia/grace
Job dir: /p/project1/ceasybuilders/eessibot/jobs/2025.10/pr_1257/14139489
| date | job status | comment |
|---|---|---|
| Oct 23 13:55:42 UTC 2025 | submitted | job id 14139489 awaits release by job manager |
| Oct 23 13:56:37 UTC 2025 | released | job awaits launch by Slurm scheduler |
| Oct 23 13:57:40 UTC 2025 | running | job 14139489 is running |
| Oct 23 17:06:02 UTC 2025 | finished | :cry: FAILURE (click triangle for details)
|
| Oct 23 17:06:02 UTC 2025 | test result | :grin: SUCCESS (click triangle for details)
|
The grace build has completed the X11 and libdrm builds, let's also retry on AWS.
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.10/pr_1257/98680
| date | job status | comment |
|---|---|---|
| Oct 23 15:03:59 UTC 2025 | submitted | job id 98680 awaits release by job manager |
| Oct 23 15:04:42 UTC 2025 | released | job awaits launch by Slurm scheduler |
| Oct 23 15:10:45 UTC 2025 | running | job 98680 is running |
| Oct 23 18:16:01 UTC 2025 | finished | :cry: FAILURE (click triangle for details)
|
| Oct 23 18:16:01 UTC 2025 | test result | :grin: SUCCESS (click triangle for details)
|
LLVM 20.1.7 build on zen 2 failed:
[100%] Built target cxx_static
-- Performing Test CXX_SUPPORTS_NOLIBC_FLAG - Success
-- Looking for __PICOLIBC__
-- Looking for __PICOLIBC__ - not found
-- Looking for __atomic_fetch_add_8 in atomic
-- Looking for __atomic_fetch_add_8 in atomic - found
-- Performing Test CXX_SUPPORTS_FALIGNED_ALLOCATION_FLAG
[100%] Linking CXX shared library /tmp/bot/easybuild/build/LLVM/20.1.7/GCCcore-14.2.0/llvm.obj.1/lib/x86_64-unknown-linux-gnu/libc++.so
cd /tmp/bot/easybuild/build/LLVM/20.1.7/GCCcore-14.2.0/llvm.obj.1/runtimes/runtimes-bins/libcxx/src && /cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/CMake/3
.31.3-GCCcore-14.2.0/bin/cmake -E cmake_link_script CMakeFiles/cxx_shared.dir/link.txt --verbose=1
/tmp/bot/easybuild/build/LLVM/20.1.7/GCCcore-14.2.0/llvm.obj.1/bin/clang++ --target=x86_64-unknown-linux-gnu --sysroot=/cvmfs/software.eessi.io/versions/2025.06/compat/linux/x86_64 -fPIC --gcc
-install-dir=/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/GCCcore/14.2.0/lib/gcc/x86_64-pc-linux-gnu/14.2.0 -fPIC -fno-semantic-interposition -fvisibility-
inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovere
d-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wsuggest-override -Wstring-conversion -Wmisleading-indentation -Wctad-maybe-unsupported -ffunction-sections -f
data-sections -O3 -DNDEBUG -Xlinker --dependency-file=CMakeFiles/cxx_shared.dir/link.d -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/zstd/1.5.6-GCCcore-14
.2.0/lib64 -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/zstd/1.5.6-GCCcore-14.2.0/lib -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/a
md/zen2/software/Z3/4.13.4-GCCcore-14.2.0/lib64 -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/Z3/4.13.4-GCCcore-14.2.0/lib -L/cvmfs/software.eessi.io/vers
ions/2025.06/software/linux/x86_64/amd/zen2/software/libxml2/2.13.4-GCCcore-14.2.0/lib64 -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/libxml2/2.13.4-GCCc
ore-14.2.0/lib -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/lit/18.1.8-GCCcore-14.2.0/lib64 -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x8
6_64/amd/zen2/software/lit/18.1.8-GCCcore-14.2.0/lib -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/psutil/7.0.0-GCCcore-14.2.0/lib64 -L/cvmfs/software.ees
si.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/psutil/7.0.0-GCCcore-14.2.0/lib -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/Python/3.13.1
-GCCcore-14.2.0/lib64 -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/Python/3.13.1-GCCcore-14.2.0/lib -L/cvmfs/software.eessi.io/versions/2025.06/software/
linux/x86_64/amd/zen2/software/GCCcore/14.2.0/lib64 -L/cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/GCCcore/14.2.0/lib -Wl,-z,defs -Wl,-z,nodelete -shared -
Wl,-soname,libc++.so.1 -o /tmp/bot/easybuild/build/LLVM/20.1.7/GCCcore-14.2.0/llvm.obj.1/lib/x86_64-unknown-linux-gnu/libc++.so.1.0 CMakeFiles/cxx_shared.dir/algorithm.cpp.o CMakeFiles/cxx_sha
red.dir/any.cpp.o CMakeFiles/cxx_shared.dir/bind.cpp.o CMakeFiles/cxx_shared.dir/call_once.cpp.o CMakeFiles/cxx_shared.dir/charconv.cpp.o CMakeFiles/cxx_shared.dir/chrono.cpp.o CMakeFiles/cxx_
shared.dir/error_category.cpp.o CMakeFiles/cxx_shared.dir/exception.cpp.o CMakeFiles/cxx_shared.dir/expected.cpp.o CMakeFiles/cxx_shared.dir/filesystem/filesystem_clock.cpp.o CMakeFiles/cxx_sh
ared.dir/filesystem/filesystem_error.cpp.o CMakeFiles/cxx_shared.dir/filesystem/path.cpp.o CMakeFiles/cxx_shared.dir/functional.cpp.o CMakeFiles/cxx_shared.dir/hash.cpp.o CMakeFiles/cxx_shared
.dir/memory.cpp.o CMakeFiles/cxx_shared.dir/memory_resource.cpp.o CMakeFiles/cxx_shared.dir/new_handler.cpp.o CMakeFiles/cxx_shared.dir/new_helpers.cpp.o CMakeFiles/cxx_shared.dir/optional.cpp
.o CMakeFiles/cxx_shared.dir/print.cpp.o CMakeFiles/cxx_shared.dir/random_shuffle.cpp.o CMakeFiles/cxx_shared.dir/ryu/d2fixed.cpp.o CMakeFiles/cxx_shared.dir/ryu/d2s.cpp.o CMakeFiles/cxx_share
d.dir/ryu/f2s.cpp.o CMakeFiles/cxx_shared.dir/stdexcept.cpp.o CMakeFiles/cxx_shared.dir/string.cpp.o CMakeFiles/cxx_shared.dir/system_error.cpp.o CMakeFiles/cxx_shared.dir/typeinfo.cpp.o CMake
Files/cxx_shared.dir/valarray.cpp.o CMakeFiles/cxx_shared.dir/variant.cpp.o CMakeFiles/cxx_shared.dir/vector.cpp.o CMakeFiles/cxx_shared.dir/verbose_abort.cpp.o CMakeFiles/cxx_shared.dir/atomi
c.cpp.o CMakeFiles/cxx_shared.dir/barrier.cpp.o CMakeFiles/cxx_sld.lld: error: /cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/GCCcore/14.2.0/lib/gcc/x86_64-p
c-linux-gnu/14.2.0/libgcc.a(_udivdi3.o):(.debug_info) is compressed with ELFCOMPRESS_ZLIB, but lld is not built with zlib support
ld.lld: error: /cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/GCCcore/14.2.0/lib/gcc/x86_64-pc-linux-gnu/14.2.0/libgcc.a(_udivdi3.o):(.debug_abbrev) is compr
essed with ELFCOMPRESS_ZLIB, but lld is not built with zlib support
ld.lld: error: /cvmfs/software.eessi.io/versions/2025.06/software/linux/x86_64/amd/zen2/software/GCCcore/14.2.0/lib/gcc/x86_64-pc-linux-gnu/14.2.0/libgcc.a(_udivdi3.o):(.debug_loclists) is com
pressed with ELFCOMPRESS_ZLIB, but lld is not built with zlib support
and many similar ones
@Crivella any idea?
It also failed for aarch64/nvidia/grace, but interestingly only in the test step:
== FAILED: Installation ended unsuccessfully: An error was raised during test step: 'Too many failed tests: 127 (10 allowed)' (took 1 hour 51 mins 14 secs)
I was afraid but almost sure this was going to happen :(
https://github.com/easybuilders/easybuild-easyblocks/pull/3881#issuecomment-3219653729
Will try to find a way to fix it using the new way deps are being handled
Let's tackle LLVM first via:
- https://github.com/EESSI/software-layer/pull/1318
@boegel The hook we have right now in
- https://github.com/EESSI/software-layer-scripts/pull/115
Should solve the original problem we had. What was left open and was hoping for some feedback in which direction we want to go was related to
- https://github.com/EESSI/software-layer-scripts/pull/115#issuecomment-3450666867
On whether we want to
- patch LLVM to avoid filtering
LIBRARY_PATH - path the EBlock to always include the
-Loption to the GCCcore location
Personally i feel the first is way more untested and could cause more trouble than the second