software-layer icon indicating copy to clipboard operation
software-layer copied to clipboard

Published 20 hours ago • verified publisher icon EESSI

{2023.6}[2023b,a64fx] ESPResSo 4.2.2 + pyMBE 0.8.0

Open boegel opened this issue 1 year ago • 8 comments

I'm using this PR to verify that the changes made for support builds for dev.eessi.io don't cause trouble for the software.eessi.io builds, so it sits on top of:

  • #771

This PR shouldn't be merged until #771 is merged, so marking it as draft...

boegel avatar Oct 11 '24 15:10 boegel

Instance eessi-bot-mc-aws is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
  • repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software

eessi-bot[bot] avatar Oct 11 '24 15:10 eessi-bot[bot]

Instance eessi-bot-mc-azure is configured to build for:

  • architectures: x86_64/amd/zen4
  • repositories: eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software, eessi.io-2023.06-compat

eessi-bot[bot] avatar Oct 11 '24 15:10 eessi-bot[bot]

bot: build repo:eessi.io-2023.06-software arch:aarch64/a64fx

boegel avatar Oct 11 '24 15:10 boegel

Updates by the bot instance eessi-bot-mc-aws (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • no jobs were submitted

eessi-bot[bot] avatar Oct 11 '24 15:10 eessi-bot[bot]

Updates by the bot instance boegel-bot-deucalion (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • submitted job 161293, for details & status see https://github.com/EESSI/software-layer/pull/782#issuecomment-2407703259

eessi-build-deploy-bot-deucalion[bot] avatar Oct 11 '24 15:10 eessi-build-deploy-bot-deucalion[bot]

Updates by the bot instance eessi-bot-mc-azure (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • no jobs were submitted

eessi-bot[bot] avatar Oct 11 '24 15:10 eessi-bot[bot]

New job on instance boegel-bot-deucalion for CPU micro-architecture aarch64-a64fx for repository eessi.io-2023.06-software in job dir /home/kehoste/project_dir/bot/jobs/2024.10/pr_782/161293

date job status comment
Oct 11 15:58:47 UTC 2024 submitted job id 161293 awaits release by job manager
Oct 11 15:59:33 UTC 2024 released job awaits launch by Slurm scheduler
Oct 11 16:00:36 UTC 2024 running job 161293 is running
Oct 11 22:29:49 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-161293.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-1728684016.tar.gzsize: 335 MiB (352166839 bytes)
entries: 37026
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
Bison/3.8.2-GCCcore-13.2.0.lua
Boost.MPI/1.83.0-gompi-2023b.lua
Brotli/1.1.0-GCCcore-13.2.0.lua
cppy/1.2.1-GCCcore-13.2.0.lua
Doxygen/1.9.8-GCCcore-13.2.0.lua
ESPResSo/4.2.2-foss-2023b.lua
fontconfig/2.14.2-GCCcore-13.2.0.lua
freetype/2.13.2-GCCcore-13.2.0.lua
giflib/5.2.1-GCCcore-13.2.0.lua
GSL/2.7-GCC-13.2.0.lua
gzip/1.13-GCCcore-13.2.0.lua
HDF5/1.14.3-gompi-2023b.lua
ICU/74.1-GCCcore-13.2.0.lua
IPython/8.17.2-GCCcore-13.2.0.lua
jbigkit/2.1-GCCcore-13.2.0.lua
jedi/0.19.1-GCCcore-13.2.0.lua
libdeflate/1.19-GCCcore-13.2.0.lua
libdrm/2.4.117-GCCcore-13.2.0.lua
libglvnd/1.7.0-GCCcore-13.2.0.lua
libiconv/1.17-GCCcore-13.2.0.lua
libjpeg-turbo/3.0.1-GCCcore-13.2.0.lua
libpng/1.6.40-GCCcore-13.2.0.lua
libsodium/1.0.19-GCCcore-13.2.0.lua
LibTIFF/4.6.0-GCCcore-13.2.0.lua
libunwind/1.6.2-GCCcore-13.2.0.lua
libwebp/1.3.2-GCCcore-13.2.0.lua
libxslt/1.1.38-GCCcore-13.2.0.lua
LittleCMS/2.15-GCCcore-13.2.0.lua
LLVM/16.0.6-GCCcore-13.2.0.lua
lxml/4.9.3-GCCcore-13.2.0.lua
lz4/1.9.4-GCCcore-13.2.0.lua
Mako/1.2.4-GCCcore-13.2.0.lua
matplotlib/3.8.2-gfbf-2023b.lua
Mesa/23.1.9-GCCcore-13.2.0.lua
NASM/2.16.01-GCCcore-13.2.0.lua
OpenJPEG/2.5.0-GCCcore-13.2.0.lua
OpenPGM/5.2.122-GCCcore-13.2.0.lua
Pillow/10.2.0-GCCcore-13.2.0.lua
Pint/0.24-GCCcore-13.2.0.lua
pyMBE/0.8.0-foss-2023b.lua
Qhull/2020.2-GCCcore-13.2.0.lua
Szip/2.1.1-GCCcore-13.2.0.lua
Tk/8.6.13-GCCcore-13.2.0.lua
Tkinter/3.11.5-GCCcore-13.2.0.lua
tqdm/4.66.2-GCCcore-13.2.0.lua
Wayland/1.22.0-GCCcore-13.2.0.lua
X11/20231019-GCCcore-13.2.0.lua
ZeroMQ/4.3.5-GCCcore-13.2.0.lua
zstd/1.5.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/a64fx/software
Bison/3.8.2-GCCcore-13.2.0
Boost.MPI/1.83.0-gompi-2023b
Brotli/1.1.0-GCCcore-13.2.0
cppy/1.2.1-GCCcore-13.2.0
Doxygen/1.9.8-GCCcore-13.2.0
ESPResSo/4.2.2-foss-2023b
fontconfig/2.14.2-GCCcore-13.2.0
freetype/2.13.2-GCCcore-13.2.0
giflib/5.2.1-GCCcore-13.2.0
GSL/2.7-GCC-13.2.0
gzip/1.13-GCCcore-13.2.0
HDF5/1.14.3-gompi-2023b
ICU/74.1-GCCcore-13.2.0
IPython/8.17.2-GCCcore-13.2.0
jbigkit/2.1-GCCcore-13.2.0
jedi/0.19.1-GCCcore-13.2.0
libdeflate/1.19-GCCcore-13.2.0
libdrm/2.4.117-GCCcore-13.2.0
libglvnd/1.7.0-GCCcore-13.2.0
libiconv/1.17-GCCcore-13.2.0
libjpeg-turbo/3.0.1-GCCcore-13.2.0
libpng/1.6.40-GCCcore-13.2.0
libsodium/1.0.19-GCCcore-13.2.0
LibTIFF/4.6.0-GCCcore-13.2.0
libunwind/1.6.2-GCCcore-13.2.0
libwebp/1.3.2-GCCcore-13.2.0
libxslt/1.1.38-GCCcore-13.2.0
LittleCMS/2.15-GCCcore-13.2.0
LLVM/16.0.6-GCCcore-13.2.0
lxml/4.9.3-GCCcore-13.2.0
lz4/1.9.4-GCCcore-13.2.0
Mako/1.2.4-GCCcore-13.2.0
matplotlib/3.8.2-gfbf-2023b
Mesa/23.1.9-GCCcore-13.2.0
NASM/2.16.01-GCCcore-13.2.0
OpenJPEG/2.5.0-GCCcore-13.2.0
OpenPGM/5.2.122-GCCcore-13.2.0
Pillow/10.2.0-GCCcore-13.2.0
Pint/0.24-GCCcore-13.2.0
pyMBE/0.8.0-foss-2023b
Qhull/2020.2-GCCcore-13.2.0
Szip/2.1.1-GCCcore-13.2.0
Tk/8.6.13-GCCcore-13.2.0
Tkinter/3.11.5-GCCcore-13.2.0
tqdm/4.66.2-GCCcore-13.2.0
Wayland/1.22.0-GCCcore-13.2.0
X11/20231019-GCCcore-13.2.0
ZeroMQ/4.3.5-GCCcore-13.2.0
zstd/1.5.5-GCCcore-13.2.0
other under 2023.06/software/linux/aarch64/a64fx
2023.06/init/minimal_eessi_env
Oct 11 22:29:49 UTC 2024 test result
:cry: FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
:white_check_mark: job output file slurm-161293.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Oct 12 20:16:06 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-a64fx-1728684016.tar.gz to S3 bucket succeeded

eessi-build-deploy-bot-deucalion[bot] avatar Oct 11 '24 15:10 eessi-build-deploy-bot-deucalion[bot]

@bedroge The 2023.06/init/minimal_eessi_env that's being deployed in here is due to the changes to it in #771, we should've done a build & deploy in there...

boegel avatar Oct 13 '24 08:10 boegel

This was deployed and ingested, but it turned out that this somehow included a wrong/old and broken version of minimal_eessi_env, so I've rolled back the transaction. We should do a rebuild here to make sure that the latest version is included, or do this in a separate PR.

bedroge avatar Oct 14 '24 08:10 bedroge

This was deployed and ingested, but it turned out that this somehow included a wrong/old and broken version of minimal_eessi_env, so I've rolled back the transaction. We should do a rebuild here to make sure that the latest version is included, or do this in a separate PR.

The build was done before the commit that adds a guard for $EESSI_COMPAT_LAYER_DIR being defined was added, see https://github.com/EESSI/software-layer/commit/1afc5995b7f53a11f8f196d1f0a7c764c348b755

Easiest way forward is just doing the build again here, which should pick up on the correct init/minimal_eessi_env...

boegel avatar Oct 14 '24 09:10 boegel

bot: build repo:eessi.io-2023.06-software arch:aarch64/a64fx

boegel avatar Oct 14 '24 09:10 boegel

Updates by the bot instance eessi-bot-mc-aws (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • no jobs were submitted

eessi-bot[bot] avatar Oct 14 '24 09:10 eessi-bot[bot]

Updates by the bot instance eessi-bot-mc-azure (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • no jobs were submitted

eessi-bot[bot] avatar Oct 14 '24 09:10 eessi-bot[bot]

Updates by the bot instance boegel-bot-deucalion (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/a64fx from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/a64fx

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/a64fx resulted in:

    • submitted job 167582, for details & status see https://github.com/EESSI/software-layer/pull/782#issuecomment-2410540162

eessi-build-deploy-bot-deucalion[bot] avatar Oct 14 '24 09:10 eessi-build-deploy-bot-deucalion[bot]

New job on instance boegel-bot-deucalion for CPU micro-architecture aarch64-a64fx for repository eessi.io-2023.06-software in job dir /home/kehoste/project_dir/bot/jobs/2024.10/pr_782/167582

date job status comment
Oct 14 09:13:22 UTC 2024 submitted job id 167582 awaits release by job manager
Oct 14 09:14:05 UTC 2024 released job awaits launch by Slurm scheduler
Oct 14 09:15:09 UTC 2024 running job 167582 is running
Oct 14 15:34:54 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-167582.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-1728918317.tar.gzsize: 335 MiB (352175732 bytes)
entries: 37026
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
Bison/3.8.2-GCCcore-13.2.0.lua
Boost.MPI/1.83.0-gompi-2023b.lua
Brotli/1.1.0-GCCcore-13.2.0.lua
cppy/1.2.1-GCCcore-13.2.0.lua
Doxygen/1.9.8-GCCcore-13.2.0.lua
ESPResSo/4.2.2-foss-2023b.lua
fontconfig/2.14.2-GCCcore-13.2.0.lua
freetype/2.13.2-GCCcore-13.2.0.lua
giflib/5.2.1-GCCcore-13.2.0.lua
GSL/2.7-GCC-13.2.0.lua
gzip/1.13-GCCcore-13.2.0.lua
HDF5/1.14.3-gompi-2023b.lua
ICU/74.1-GCCcore-13.2.0.lua
IPython/8.17.2-GCCcore-13.2.0.lua
jbigkit/2.1-GCCcore-13.2.0.lua
jedi/0.19.1-GCCcore-13.2.0.lua
libdeflate/1.19-GCCcore-13.2.0.lua
libdrm/2.4.117-GCCcore-13.2.0.lua
libglvnd/1.7.0-GCCcore-13.2.0.lua
libiconv/1.17-GCCcore-13.2.0.lua
libjpeg-turbo/3.0.1-GCCcore-13.2.0.lua
libpng/1.6.40-GCCcore-13.2.0.lua
libsodium/1.0.19-GCCcore-13.2.0.lua
LibTIFF/4.6.0-GCCcore-13.2.0.lua
libunwind/1.6.2-GCCcore-13.2.0.lua
libwebp/1.3.2-GCCcore-13.2.0.lua
libxslt/1.1.38-GCCcore-13.2.0.lua
LittleCMS/2.15-GCCcore-13.2.0.lua
LLVM/16.0.6-GCCcore-13.2.0.lua
lxml/4.9.3-GCCcore-13.2.0.lua
lz4/1.9.4-GCCcore-13.2.0.lua
Mako/1.2.4-GCCcore-13.2.0.lua
matplotlib/3.8.2-gfbf-2023b.lua
Mesa/23.1.9-GCCcore-13.2.0.lua
NASM/2.16.01-GCCcore-13.2.0.lua
OpenJPEG/2.5.0-GCCcore-13.2.0.lua
OpenPGM/5.2.122-GCCcore-13.2.0.lua
Pillow/10.2.0-GCCcore-13.2.0.lua
Pint/0.24-GCCcore-13.2.0.lua
pyMBE/0.8.0-foss-2023b.lua
Qhull/2020.2-GCCcore-13.2.0.lua
Szip/2.1.1-GCCcore-13.2.0.lua
Tk/8.6.13-GCCcore-13.2.0.lua
Tkinter/3.11.5-GCCcore-13.2.0.lua
tqdm/4.66.2-GCCcore-13.2.0.lua
Wayland/1.22.0-GCCcore-13.2.0.lua
X11/20231019-GCCcore-13.2.0.lua
ZeroMQ/4.3.5-GCCcore-13.2.0.lua
zstd/1.5.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/a64fx/software
Bison/3.8.2-GCCcore-13.2.0
Boost.MPI/1.83.0-gompi-2023b
Brotli/1.1.0-GCCcore-13.2.0
cppy/1.2.1-GCCcore-13.2.0
Doxygen/1.9.8-GCCcore-13.2.0
ESPResSo/4.2.2-foss-2023b
fontconfig/2.14.2-GCCcore-13.2.0
freetype/2.13.2-GCCcore-13.2.0
giflib/5.2.1-GCCcore-13.2.0
GSL/2.7-GCC-13.2.0
gzip/1.13-GCCcore-13.2.0
HDF5/1.14.3-gompi-2023b
ICU/74.1-GCCcore-13.2.0
IPython/8.17.2-GCCcore-13.2.0
jbigkit/2.1-GCCcore-13.2.0
jedi/0.19.1-GCCcore-13.2.0
libdeflate/1.19-GCCcore-13.2.0
libdrm/2.4.117-GCCcore-13.2.0
libglvnd/1.7.0-GCCcore-13.2.0
libiconv/1.17-GCCcore-13.2.0
libjpeg-turbo/3.0.1-GCCcore-13.2.0
libpng/1.6.40-GCCcore-13.2.0
libsodium/1.0.19-GCCcore-13.2.0
LibTIFF/4.6.0-GCCcore-13.2.0
libunwind/1.6.2-GCCcore-13.2.0
libwebp/1.3.2-GCCcore-13.2.0
libxslt/1.1.38-GCCcore-13.2.0
LittleCMS/2.15-GCCcore-13.2.0
LLVM/16.0.6-GCCcore-13.2.0
lxml/4.9.3-GCCcore-13.2.0
lz4/1.9.4-GCCcore-13.2.0
Mako/1.2.4-GCCcore-13.2.0
matplotlib/3.8.2-gfbf-2023b
Mesa/23.1.9-GCCcore-13.2.0
NASM/2.16.01-GCCcore-13.2.0
OpenJPEG/2.5.0-GCCcore-13.2.0
OpenPGM/5.2.122-GCCcore-13.2.0
Pillow/10.2.0-GCCcore-13.2.0
Pint/0.24-GCCcore-13.2.0
pyMBE/0.8.0-foss-2023b
Qhull/2020.2-GCCcore-13.2.0
Szip/2.1.1-GCCcore-13.2.0
Tk/8.6.13-GCCcore-13.2.0
Tkinter/3.11.5-GCCcore-13.2.0
tqdm/4.66.2-GCCcore-13.2.0
Wayland/1.22.0-GCCcore-13.2.0
X11/20231019-GCCcore-13.2.0
ZeroMQ/4.3.5-GCCcore-13.2.0
zstd/1.5.5-GCCcore-13.2.0
other under 2023.06/software/linux/aarch64/a64fx
2023.06/init/minimal_eessi_env
Oct 14 15:34:54 UTC 2024 test result
:cry: FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
:white_check_mark: job output file slurm-167582.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Oct 14 15:49:02 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-a64fx-1728918317.tar.gz to S3 bucket succeeded

eessi-build-deploy-bot-deucalion[bot] avatar Oct 14 '24 09:10 eessi-build-deploy-bot-deucalion[bot]

@bedroge Can you verify that the init/minimal_eessi_env in the tarball is correct now?

boegel avatar Oct 14 '24 15:10 boegel

@bedroge Can you verify that the init/minimal_eessi_env in the tarball is correct now?

Extracted the tarball and did a diff with the file from the software-layer repo:

[bob@multixscale-stratum0 tmp]$ diff 2023.06/init/minimal_eessi_env software-layer/init/minimal_eessi_env 
[bob@multixscale-stratum0 tmp]$

And, indeed, the file now has:

# set $EPREFIX since that is basically a standard in Gentoo Prefix
# if $EESSI_COMPAT_LAYER_DIR is defined (for example by run_in_compat_layer_env.sh script), we use that value
if [ ! -z ${EESSI_COMPAT_LAYER_DIR} ]; then
    export EPREFIX=$EESSI_COMPAT_LAYER_DIR
else
    export EPREFIX=$EESSI_PREFIX/compat/$EESSI_OS_TYPE/$EESSI_CPU_FAMILY
fi

So, looks good to me now.

bedroge avatar Oct 14 '24 17:10 bedroge

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.14

eessi-bot[bot] avatar Oct 14 '24 19:10 eessi-bot[bot]

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.14

eessi-bot[bot] avatar Oct 14 '24 19:10 eessi-bot[bot]