reframe icon indicating copy to clipboard operation
reframe copied to clipboard

4.5.0: unable to bootstap

Open j-ogas opened this issue 1 year ago • 7 comments

I am unable to bootstrap with (1) my Cray system python 3.6.15, or (2) the supplemental python 3.10.9 provided via module.

3.6.15

$ python3 -V
Python 3.6.15
$ ./bootstrap.sh
==> python3 -m venv --without-pip /tmp/tmp.bnm6WmPenP
==> source /tmp/tmp.bnm6WmPenP/bin/activate
==> curl -s https://bootstrap.pypa.io/pip/3.6/get-pip.py | python3
==> python3 -m pip install --no-cache-dir -q -r requirements.txt --target=external/x86_64/ --upgrade
/tmp/tmp.bnm6WmPenP/bin/python3: No module named pip

3.10

$ module load python
$ python3 -V
Python 3.10.9
$ ./bootstrap.sh
==> python3 -m venv --without-pip /tmp/tmp.12jqDrcBQR
==> source /tmp/tmp.12jqDrcBQR/bin/activate
==> curl -s https://bootstrap.pypa.io/get-pip.py | python3
==> python3 -m pip install --no-cache-dir -q -r requirements.txt --target=external/x86_64/ --upgrade
/tmp/tmp.12jqDrcBQR/bin/python3: No module named pip

j-ogas avatar Dec 21 '23 17:12 j-ogas

Under the curl command that gets pip for you, you should see something like this:

curl -s https://bootstrap.pypa.io/pip/3.6/get-pip.py | python3
Collecting pip<22.0
  Using cached pip-21.3.1-py3-none-any.whl (1.7 MB)
Collecting setuptools
  Using cached setuptools-59.6.0-py3-none-any.whl (952 kB)
Collecting wheel
  Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: wheel, setuptools, pip
Successfully installed pip-21.3.1 setuptools-59.6.0 wheel-0.37.1

teojgo avatar Dec 21 '23 17:12 teojgo

@j-ogas Is curl available on your system?

vkarak avatar Jan 19 '24 21:01 vkarak

@j-ogas Is curl available on your system?

Yes, however, we sit behind a whitelist firewall and a proxy. Note that proxy variables are set when executing the bootstrap.

FWIW, I can use the 4.4.2 bootstrap without issue in the same environment.

j-ogas avatar Jan 22 '24 16:01 j-ogas

The bootstrap script works differently in 4.5. It starts a pip-less virtual environment and downloads pip and installs it. Can you run successfully the curl command from the machine that you try to install reframe in?

curl -s https://bootstrap.pypa.io/pip/3.6/get-pip.py

vkarak avatar Feb 15 '24 21:02 vkarak

The bootstrap script works differently in 4.5. It starts a pip-less virtual environment and downloads pip and installs it. Can you run successfully the curl command from the machine that you try to install reframe in?

curl -s https://bootstrap.pypa.io/pip/3.6/get-pip.py

Unfortunately it does not, we are behind a whitelist firewall. I suppose I could try and pester our site admins to allow the URL above.

j-ogas avatar Feb 21 '24 16:02 j-ogas

We could ship the get-pip script with reframe and resort to this in the bootstrap script if the download fails.

vkarak avatar May 14 '24 20:05 vkarak

We could ship the get-pip script with reframe and resort to this in the bootstrap script if the download fails.

That would be lovely.

j-ogas avatar May 14 '24 22:05 j-ogas