easybuild-easyblocks icon indicating copy to clipboard operation
easybuild-easyblocks copied to clipboard

Avoid failure in Python package installation and sanity check when `$PIP_REQUIRE_VIRTUALENV` is set

Open Flamefire opened this issue 1 year ago • 3 comments
trafficstars

We already have it for the installation if set by users but if a module sets it (e.g Python) the sanity check will fail

Flamefire avatar Sep 24 '24 10:09 Flamefire

@boegelbot please test @ jsc-zen3-a100 EB_ARGS="tensorflow-compression-2.11.0-foss-2022a-CUDA-11.7.0.eb TensorFlow-2.15.1-foss-2023a.eb --installpath /tmp/$USER/pr3460"

boegel avatar Oct 09 '24 09:10 boegel

@boegel: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=3460 EB_ARGS="tensorflow-compression-2.11.0-foss-2022a-CUDA-11.7.0.eb TensorFlow-2.15.1-foss-2023a.eb --installpath /tmp/$USER/pr3460" EB_REPO=easybuild-easyblocks EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_3460 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 5038

Test results coming soon (I hope)...

- notification for comment with ID 2401832507 processed

Message to humans: this is just bookkeeping information for me, it is of no use to you (unless you think I have a bug, which I don't).

boegelbot avatar Oct 09 '24 09:10 boegelbot

Test report by @boegelbot

Overview of tested easyconfigs (in order)

  • SUCCESS tensorflow-compression-2.11.0-foss-2022a-CUDA-11.7.0.eb
  • SUCCESS TensorFlow-2.15.1-foss-2023a.eb

Build succeeded for 2 out of 2 (2 easyconfigs in total) jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18 See https://gist.github.com/boegelbot/4b82c97538296dae8d67d812cc0e9f72 for a full test report.

boegelbot avatar Oct 09 '24 13:10 boegelbot

@boegel ping on that. Just ran into this failure while testing EB 5 ECs.

Flamefire avatar Feb 18 '25 10:02 Flamefire

Rebased for 5.0x

Flamefire avatar Mar 21 '25 12:03 Flamefire

Can this be included in 5.0.1? I had to patch our 5.0.0 installation again after the update. And test reports looked fine too so I don't expect any downsides.

Flamefire avatar Apr 10 '25 11:04 Flamefire

Can this be included in 5.0.1? I had to patch our 5.0.0 installation again after the update. And test reports looked fine too so I don't expect any downsides.

I'll see what I can do to get this merged ASAP

boegel avatar Apr 23 '25 07:04 boegel

Test report by @boegel

Overview of tested easyconfigs (in order)

  • SUCCESS Python-2.7.18-GCCcore-12.3.0.eb
  • SUCCESS Python-3.12.3-GCCcore-13.3.0.eb
  • SUCCESS matplotlib-3.9.2-gfbf-2024a.eb
  • SUCCESS numexpr-2.9.0-foss-2023a.eb
  • SUCCESS TensorFlow-2.13.0-foss-2023a.eb

Build succeeded for 5 out of 5 (5 easyconfigs in total) node3502.doduo.os - Linux RHEL 9.4, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.9.18 See https://gist.github.com/boegel/63fade637b46537fb613f90197c33773 for a full test report.

boegel avatar May 23 '25 15:05 boegel

Rebased without changes to resolve merge conflict

Flamefire avatar May 23 '25 15:05 Flamefire