software-layer
software-layer copied to clipboard
{2023.06}[2023a] Extrae 4.0.6 (WIP)
Instance eessi-bot-mc-azure is configured to build:
- arch
x86_64/amd/zen4for repoeessi-hpc.org-2023.06-compat - arch
x86_64/amd/zen4for repoeessi-hpc.org-2023.06-software - arch
x86_64/amd/zen4for repoeessi.io-2023.06-compat - arch
x86_64/amd/zen4for repoeessi.io-2023.06-software
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1
Updates by the bot instance eessi-bot-mc-aws
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1resulted in:- submitted job
9894, for details & status see https://github.com/EESSI/software-layer/pull/554#issuecomment-2079576167
- submitted job
Updates by the bot instance eessi-bot-mc-azure
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1resulted in:- no jobs were submitted
New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_554/9894
| date | job status | comment |
|---|---|---|
| Apr 26 15:06:28 UTC 2024 | submitted | job id 9894 awaits release by job manager |
| Apr 26 15:07:10 UTC 2024 | released | job awaits launch by Slurm scheduler |
| Apr 26 15:12:12 UTC 2024 | running | job 9894 is running |
| Apr 26 15:37:37 UTC 2024 | finished | :cry: FAILURE (click triangle for details)
|
| Apr 26 15:37:37 UTC 2024 | test result | :grin: SUCCESS (click triangle for details)
|
bot: build repo:eessi.io-2023.06-software arch:x86_64/generic
Updates by the bot instance eessi-bot-mc-aws
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:x86_64/genericfromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:x86_64/generic
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:x86_64/genericresulted in:- submitted job
9969, for details & status see https://github.com/EESSI/software-layer/pull/554#issuecomment-2082209745
- submitted job
Updates by the bot instance eessi-bot-mc-azure
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:x86_64/genericfromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:x86_64/generic
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:x86_64/genericresulted in:- no jobs were submitted
New job on instance eessi-bot-mc-aws for architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_554/9969
| date | job status | comment |
|---|---|---|
| Apr 29 09:02:20 UTC 2024 | submitted | job id 9969 awaits release by job manager |
| Apr 29 09:02:46 UTC 2024 | released | job awaits launch by Slurm scheduler |
| Apr 29 09:07:48 UTC 2024 | running | job 9969 is running |
| Apr 29 09:31:10 UTC 2024 | finished | :cry: FAILURE (click triangle for details)
|
| Apr 29 09:31:10 UTC 2024 | test result | :grin: SUCCESS (click triangle for details)
|
./configure ... is failing with:
checking for binutils... notfound
configure: libbfd library directory: /usr/lib/x86_64-linux-gnu
configure: Warning! Cannot find the libiberty library in the given binutils home. Please, make sure that the binutils packages is correctly installed. If you have installed the binutils package by hand from their source code, make sure that libiberty is installed. Some releases of the binutils package do not install the libibery even invoking make install. The library should be within the libiberty directory within the binutils source tree.
checking for bfd.h... no
configure: error: You have asked to gather call-site information through --with-unwind which must be translated using binutils, but either libbfd or libiberty are not found. Please make sure that the binutils-dev package is installed and specify where to find these libraries through --with-binutils. The latest source can be downloaded from http://www.gnu.org/software/binutils
Despite the patch added in https://github.com/easybuilders/easybuild-easyconfigs/pull/20153, it's not able yet to find the binutils from the EESSI compat layer. I had this working somehow during the EuroHPC Summit week, but perhaps I had an extra change/fix somewhere back then which I didn't keep track of...
Including this in the Extrae easyconfig (which should be done either in the custom easyblock for Extra, or in the hooks we use in EESSI) helps:
configopts = "--with-binutils=%(sysroot)s/usr/lib*/binutils/x86_64-pc-linux-gnu/2.*/"
but then there's a problem in the build step, I don't recall hitting this one before...
configure: error: Cannot find given ${MPIF77}. Please give the full path for the MPI F77 compiler
checking for mpicc compiler default binary type... 64-bit
configure: cannot locate multiarch triplet
checking for mpicxx compiler default binary type... 64-bit
configure: cannot locate multiarch triplet
checking for MPI installation... /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/OpenMPI/4.1.5-GCC-12.3.0
checking for MPI binaries directory... /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/OpenMPI/4.1.5-GCC-12.3.0/bin
checking for MPI includes directory... /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/OpenMPI/4.1.5-GCC-12.3.0/include
checking for MPI libraries directory... /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/OpenMPI/4.1.5-GCC-12.3.0/lib64
checking for MPI shared library folder... no
checking for MPI multiarch library folder... no
checking for MPI valid installation... yes
checking for mpi.h... yes
checking for MPICH2 defined... no
checking for MPI library... /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/OpenMPI/4.1.5-GCC-12.3.0/lib64, -lmpi
checking for shared MPI library... yes
checking for fortran MPI library... not found,
checking for MPI C compiler... mpicc
checking for MPI F77 compiler... Illegal option --
./configure: line 11789: test: too many arguments
configure: error: Cannot find given ${MPIF77}. Please give the full path for the MPI F77 compiler
make: *** [Makefile:1240: config.status] Error 2
The issue with $MPIF77 is caused by the use of which in Extrae's configure script:
if test -x `which ${MPIF77}` ; then
{ printf "%s\n" "$as_me:${as_lineno-$LINENO}: result: ${MPIF77}" >&5
printf "%s\n" "${MPIF77}" >&6; }
else
as_fn_error $? "Cannot find given \${MPIF77}. Please give the full path for the MPI F77 compiler" "$LINENO" 5
fi
That fails in the EESSI build container, because which doesn't work there:
{EESSI 2023.06} Apptainer> which ls
Illegal option --
Usage: /usr/bin/which [-a] args
command -v can be used instead:
{EESSI 2023.06} Apptainer> command -v ls
/cvmfs/software.eessi.io/versions/2023.06/compat/linux/x86_64/bin/ls
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512
Updates by the bot instance eessi-bot-mc-aws
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512resulted in:- submitted job
10463, for details & status see https://github.com/EESSI/software-layer/pull/554#issuecomment-2106245323
- submitted job
Updates by the bot instance eessi-bot-mc-azure
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512resulted in:- no jobs were submitted
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_554/10463
| date | job status | comment |
|---|---|---|
| May 12 13:22:41 UTC 2024 | submitted | job id 10463 awaits release by job manager |
| May 12 13:22:56 UTC 2024 | released | job awaits launch by Slurm scheduler |
| May 12 13:27:58 UTC 2024 | running | job 10463 is running |
| May 12 13:49:33 UTC 2024 | finished | :cry: FAILURE (click triangle for details)
|
| May 12 13:49:33 UTC 2024 | test result | :grin: SUCCESS (click triangle for details)
|
edit: failed because of incorrectly disabling test suite by setting runtest to False
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1
Updates by the bot instance eessi-bot-mc-aws
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1resulted in:- submitted job
10465, for details & status see https://github.com/EESSI/software-layer/pull/554#issuecomment-2106252599
- submitted job
Updates by the bot instance eessi-bot-mc-azure
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1resulted in:- no jobs were submitted
New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_554/10465
| date | job status | comment |
|---|---|---|
| May 12 13:46:18 UTC 2024 | submitted | job id 10465 awaits release by job manager |
| May 12 13:46:26 UTC 2024 | released | job awaits launch by Slurm scheduler |
| May 12 13:51:38 UTC 2024 | running | job 10465 is running |
| May 12 14:18:41 UTC 2024 | finished | :cry: FAILURE (click triangle for details)
|
| May 12 14:18:41 UTC 2024 | test result | :grin: SUCCESS (click triangle for details)
|
edit: failed because of incorrectly disabling test suite by setting runtest to False
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512
Updates by the bot instance eessi-bot-mc-aws
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512resulted in:- submitted job
10467, for details & status see https://github.com/EESSI/software-layer/pull/554#issuecomment-2106256487
- submitted job
Updates by the bot instance eessi-bot-mc-azure
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512resulted in:- no jobs were submitted
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_554/10467
| date | job status | comment |
|---|---|---|
| May 12 14:00:38 UTC 2024 | submitted | job id 10467 awaits release by job manager |
| May 12 14:01:03 UTC 2024 | released | job awaits launch by Slurm scheduler |
| May 12 14:02:08 UTC 2024 | running | job 10467 is running |
| May 12 14:20:44 UTC 2024 | finished | :cry: FAILURE (click triangle for details)
|
| May 12 14:20:44 UTC 2024 | test result | :grin: SUCCESS (click triangle for details)
|
edit: failed due to Failed to get data for PR #20050 from easybuilders/easybuild-easyconfigs (HTTP Error 403: rate limit exceeded)
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512
Updates by the bot instance eessi-bot-mc-aws
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512resulted in:- submitted job
10468, for details & status see https://github.com/EESSI/software-layer/pull/554#issuecomment-2106382131
- submitted job
Updates by the bot instance eessi-bot-mc-azure
(click for details)
-
received bot command
build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512fromboegel- expanded format:
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
- expanded format:
-
handling command
build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512resulted in:- no jobs were submitted
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_554/10468
| date | job status | comment |
|---|---|---|
| May 12 21:38:29 UTC 2024 | submitted | job id 10468 awaits release by job manager |
| May 12 21:39:20 UTC 2024 | released | job awaits launch by Slurm scheduler |
| May 12 21:43:22 UTC 2024 | running | job 10468 is running |
| May 12 22:09:48 UTC 2024 | finished | :cry: FAILURE (click triangle for details)
|
| May 12 22:09:48 UTC 2024 | test result | :grin: SUCCESS (click triangle for details)
|
We should be able to update this now for https://github.com/easybuilders/easybuild-easyconfigs/pull/20690 and easyblock PR 3339
Closing this in favour of #640 where we are much closer to a working build