open-ce icon indicating copy to clipboard operation
open-ce copied to clipboard

[BUG] libopenblas conda conflict in current

Open mjdiff opened this issue 1 year ago • 2 comments

Describe the bug

As bellow, libopenblas cannot be resolved

To Reproduce conda create -n testenv pytorch-base --dry-run -c https://ftp.osuosl.org/pub/open-ce/current -c conda

Expected behavior I would expect the resolution of dependencies and installation of packages

Execution Logs

conda create -n testenv  pytorch-base --dry-run -c  https://ftp.osuosl.org/pub/open-ce/current -c conda
Channels:
 - https://ftp.osuosl.org/pub/open-ce/current
 - conda
 - conda-forge
Platform: linux-ppc64le
Collecting package metadata (repodata.json): -                                                                                 done
Solving environment: failed

LibMambaUnsatisfiableError: Encountered problems while solving:
  - package pytorch-base-2.1.2-cpu_py310_pb4.21.12_7 requires scipy 1.11.*, but none of the providers can be installed

Could not solve for environment specs
The following package could not be installed
└─ pytorch-base is not installable because it requires
   ├─ libopenblas >=0.3.27,<1.0a0 , which can be installed;
   └─ scipy 1.11.* , which requires
      └─ libopenblas <0.3.26 , which conflicts with any installable versions previously reported.

System (please complete the following information):

  • OS: Ubuntu 20.04
  • Architecture Power9

Additional context

mjdiff avatar Aug 27 '24 13:08 mjdiff

Here's your problem:

Channels:
 - https://ftp.osuosl.org/pub/open-ce/current
 - conda
 - conda-forge

Open CE requires the Anaconda main channel, instead of conda-forge.

rolweber avatar Aug 28 '24 04:08 rolweber

Here's your problem:

Channels:
 - https://ftp.osuosl.org/pub/open-ce/current
 - conda
 - conda-forge

Open CE requires the Anaconda main channel, instead of conda-forge.

@rolweber, thanks. This is what I was expecting. Is there any way to avoid the conda default channel? The only problem is the Scipy package, which needs a default channel. If we could pull everything from Conda-forge, this would solve some issues with Anaconda licensing, which is now quite strict for the Anaconda default channel. For release 1.10 everything can be pulled from conda-forge.

Update: There is a walkaround to this by using 'fastchan' channel and pulling scipy from it, but maybe we could avoid using it:

 + scipy                      1.11.2  py311hbc68021_0             fastchan                                 18MB

Current -1.11.2


 mamba create --name test_env --override-channels    -c https://ftp.osuosl.org/pub/open-ce/current  -c conda-forge -c defaults  pytorch-base --dry-run


 Package                     Version  Build                       Channel                                  Size
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────
  Install:
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────

  + _pytorch_select               2.0  cuda_2                      ftp.osuosl.org/pub/open-ce/current        4kB
  + blas                          1.0  openblas                    ftp.osuosl.org/pub/open-ce/current        9kB
  + _libgcc_mutex                 0.1  conda_forge                 conda-forge                               3kB
  + python_abi                   3.11  5_cp311                     conda-forge                               6kB
  + ld_impl_linux-ppc64le        2.40  h60d6e0b_7                  conda-forge                            Cached
  + ca-certificates          2024.7.4  h0f6029e_0                  conda-forge                            Cached
  + libgomp                    14.1.0  h31e42bb_1                  conda-forge                            Cached
  + _openmp_mutex                 4.5  2_gnu                       conda-forge                              24kB
  + libgcc                     14.1.0  h31e42bb_1                  conda-forge                            Cached
  + libstdcxx                  14.1.0  h262982c_1                  conda-forge                               4MB
  + libgfortran5               14.1.0  h1b36799_1                  conda-forge                               1MB
  + libgcc-ng                  14.1.0  hfdc3801_1                  conda-forge                              52kB
  + libstdcxx-ng               14.1.0  hf27a640_1                  conda-forge                              52kB
  + libgfortran                14.1.0  hfdc3801_1                  conda-forge                              52kB
  + xorg-libxdmcp               1.1.3  h4e0d66e_0                  conda-forge                            Cached
  + pthread-stubs                 0.4  h339bb43_1001               conda-forge                               6kB
  + xorg-libxau                1.0.11  ha17a0cc_0                  conda-forge                            Cached
  + libwebp-base                1.4.0  ha17a0cc_0                  conda-forge                            Cached
  + libdeflate                   1.20  ha17a0cc_0                  conda-forge                              71kB
  + libjpeg-turbo               3.0.0  ha17a0cc_1                  conda-forge                             733kB
  + openssl                     3.3.1  h190368a_3                  conda-forge                            Cached
  + ncurses                       6.5  hd444e8b_1                  conda-forge                            Cached
  + xz                          5.2.6  hb283c62_0                  conda-forge                            Cached
  + libffi                      3.4.2  h4e0d66e_5                  conda-forge                            Cached
  + bzip2                       1.0.8  h1f2b957_7                  conda-forge                            Cached
  + yaml                        0.2.5  h4e0d66e_2                  conda-forge                            Cached
  + libzlib                    1.2.13  h1f2b957_6                  conda-forge                            Cached
  + libxcrypt                  4.4.36  ha17a0cc_1                  conda-forge                            Cached
  + libuuid                    2.38.1  h4194056_0                  conda-forge                            Cached
  + libnsl                      2.0.1  ha17a0cc_0                  conda-forge                            Cached
  + libexpat                    2.6.2  h46f38da_0                  conda-forge                            Cached
  + lmdb                       0.9.31  ha17a0cc_1                  conda-forge                            Cached
  + lerc                        4.0.0  hbbae597_0                  conda-forge                            Cached
  + snappy                      1.2.1  h0c9a444_0                  conda-forge                            Cached
  + gmp                         6.3.0  h46f38da_0                  conda-forge                            Cached
  + libgfortran-ng             14.1.0  hfdc3801_1                  conda-forge                              52kB
  + libxcb                       1.15  h4194056_0                  conda-forge                             395kB
  + readline                      8.2  h0b9b154_1                  conda-forge                            Cached
  + zstd                        1.5.6  h03a2076_0                  conda-forge                            Cached
  + libpng                     1.6.43  hd4bbf49_0                  conda-forge                            Cached
  + libsqlite                  3.46.0  h4fdbfcb_0                  conda-forge                            Cached
  + zlib                       1.2.13  h1f2b957_6                  conda-forge                            Cached
  + tk                         8.6.13  hd4bbf49_0                  conda-forge                            Cached
  + leveldb                      1.23  h719eb63_2                  conda-forge                            Cached
  + mpfr                        4.2.1  haad2271_1                  conda-forge                            Cached
  + libtiff                     4.6.0  hcbea7e6_3                  conda-forge                             341kB
  + freetype                   2.12.1  h5baba08_2                  conda-forge                            Cached
  + mpc                         1.3.1  heaf1863_0                  conda-forge                            Cached
  + openjpeg                    2.5.2  h1c3486c_0                  conda-forge                             441kB
  + lcms2                        2.16  ha74cc02_0                  conda-forge                             323kB
  + cuda-version                 12.2  he2b69de_3                  conda-forge                              21kB
  + tzdata                      2024a  h8827d51_1                  conda-forge                            Cached
  + numactl                    2.0.16  hba61f60_1                  ftp.osuosl.org/pub/open-ce/current      120kB
  + cudatoolkit                12.2.0  h04ed88e_3                  ftp.osuosl.org/pub/open-ce/current      594MB
  + libprotobuf               3.21.12  h1776448_0                  ftp.osuosl.org/pub/open-ce/current        2MB
  + llvm-openmp                14.0.6  hc028133_0                  ftp.osuosl.org/pub/open-ce/current        1MB
  + libnvjitlink             12.2.140  ha7baec7_0                  ftp.osuosl.org/pub/open-ce/current       15MB
  + nccl                       2.19.3  cuda12.2_1                  ftp.osuosl.org/pub/open-ce/current      101MB
  + cudnn                  8.9.6_12.2  hd061a7d_1                  ftp.osuosl.org/pub/open-ce/current      873MB
  + libopenblas                0.3.27  hc5a31fb_1                  ftp.osuosl.org/pub/open-ce/current        4MB
  + python                     3.11.9  hbe116a8_0_cpython          conda-forge                            Cached
  + libblas                     3.9.0  23_linuxppc64le_openblas    conda-forge                              15kB
  + libcblas                    3.9.0  23_linuxppc64le_openblas    conda-forge                              15kB
  + liblapack                   3.9.0  23_linuxppc64le_openblas    conda-forge                              15kB
  + wheel                      0.44.0  pyhd8ed1ab_0                conda-forge                            Cached
  + setuptools                 72.2.0  pyhd8ed1ab_0                conda-forge                            Cached
  + pip                          24.2  pyhd8ed1ab_0                conda-forge                            Cached
  + pycparser                    2.22  pyhd8ed1ab_0                conda-forge                            Cached
  + mpmath                      1.3.0  pyhd8ed1ab_0                conda-forge                            Cached
  + typing_extensions           4.7.1  pyha770c72_0                conda-forge                              36kB
  + tabulate                   0.8.10  pyhd8ed1ab_0                conda-forge                            Cached
  + networkx                    2.8.8  pyhd8ed1ab_0                conda-forge                            Cached
  + filelock                   3.15.4  pyhd8ed1ab_0                conda-forge                            Cached
  + click                       8.1.7  unix_pyh707e725_0           conda-forge                            Cached
  + pillow                     10.3.0  py311he6692c3_0             conda-forge                              42MB
  + markupsafe                  2.1.5  py311h32d8acf_0             conda-forge                            Cached
  + gmpy2                       2.1.5  py311h2758da7_1             conda-forge                            Cached
  + numpy                      1.26.4  py311hbc68021_0             conda-forge                               8MB
  + pyyaml                      6.0.2  py311hb02d432_0             conda-forge                             212kB
  + cffi                       1.15.1  py311h368c2b5_5             conda-forge                            Cached
  + protobuf                  4.21.12  py311ha7baec7_1             ftp.osuosl.org/pub/open-ce/current      380kB
  + fsspec                  2023.10.0  pyh6818f58_0                ftp.osuosl.org/pub/open-ce/current      123kB
  + jinja2                      3.1.4  pyhd8ed1ab_0                conda-forge                            Cached
  + sympy                      1.13.2  pypyh2585a3b_103            conda-forge                               5MB
  + scipy                      1.11.3  py311he4133b3_0             pkgs/main                                25MB
  + pytorch-base                2.1.2  cuda12.2_py311_pb4.21.12_7  ftp.osuosl.org/pub/open-ce/current      354MB

Release 1.10.0

mamba create --name test_env --override-channels    -c https://ftp.osuosl.org/pub/open-ce/1.10.0  -c conda-forge -c defaults  pytorch-base --dry-run

Looking for: ['pytorch-base']

conda-forge/linux-ppc64le                                   Using cache
conda-forge/noarch                                          Using cache
pkgs/main/linux-ppc64le                                       No change
pkgs/main/noarch                                              No change
pkgs/r/linux-ppc64le                                          No change
pkgs/r/noarch                                                 No change
https://ftp.osuosl.org/pub/open-ce/1.10.0/linux-..            No change
https://ftp.osuosl.org/pub/open-ce/1.10.0/noarch              No change
Transaction

  Prefix: /home/esrf/jankowsk/miniforge_p9/envs/test_env

  Updating specs:

   - pytorch-base


  Package                     Version  Build                       Channel                                 Size
─────────────────────────────────────────────────────────────────────────────────────────────────────────────────
  Install:
─────────────────────────────────────────────────────────────────────────────────────────────────────────────────

  + _pytorch_select               2.0  cuda_2                      ftp.osuosl.org/pub/open-ce/1.10.0        4kB
  + blas                          1.0  openblas                    ftp.osuosl.org/pub/open-ce/1.10.0        9kB
  + nomkl                         3.0  0                           ftp.osuosl.org/pub/open-ce/1.10.0        9kB
  + _libgcc_mutex                 0.1  conda_forge                 conda-forge                              3kB
  + python_abi                   3.11  5_cp311                     conda-forge                              6kB
  + ld_impl_linux-ppc64le        2.40  h60d6e0b_7                  conda-forge                           Cached
  + ca-certificates          2024.7.4  h0f6029e_0                  conda-forge                           Cached
  + libgomp                    14.1.0  h31e42bb_1                  conda-forge                           Cached
  + _openmp_mutex                 4.5  2_gnu                       conda-forge                             24kB
  + libgcc                     14.1.0  h31e42bb_1                  conda-forge                           Cached
  + libstdcxx                  14.1.0  h262982c_1                  conda-forge                              4MB
  + libgfortran5               14.1.0  h1b36799_1                  conda-forge                              1MB
  + libgcc-ng                  14.1.0  hfdc3801_1                  conda-forge                             52kB
  + libstdcxx-ng               14.1.0  hf27a640_1                  conda-forge                             52kB
  + libgfortran                14.1.0  hfdc3801_1                  conda-forge                             52kB
  + xorg-libxdmcp               1.1.3  h4e0d66e_0                  conda-forge                           Cached
  + pthread-stubs                 0.4  h339bb43_1001               conda-forge                              6kB
  + xorg-libxau                1.0.11  ha17a0cc_0                  conda-forge                           Cached
  + libwebp-base                1.4.0  ha17a0cc_0                  conda-forge                           Cached
  + libdeflate                   1.20  ha17a0cc_0                  conda-forge                             71kB
  + libjpeg-turbo               3.0.0  ha17a0cc_1                  conda-forge                            733kB
  + openssl                     3.3.1  h190368a_3                  conda-forge                           Cached
  + ncurses                       6.5  hd444e8b_1                  conda-forge                           Cached
  + xz                          5.2.6  hb283c62_0                  conda-forge                           Cached
  + libffi                      3.4.2  h4e0d66e_5                  conda-forge                           Cached
  + bzip2                       1.0.8  h1f2b957_7                  conda-forge                           Cached
  + yaml                        0.2.5  h4e0d66e_2                  conda-forge                           Cached
  + libzlib                    1.2.13  h1f2b957_6                  conda-forge                           Cached
  + libxcrypt                  4.4.36  ha17a0cc_1                  conda-forge                           Cached
  + libuuid                    2.38.1  h4194056_0                  conda-forge                           Cached
  + libnsl                      2.0.1  ha17a0cc_0                  conda-forge                           Cached
  + libexpat                    2.6.2  h46f38da_0                  conda-forge                           Cached
  + lmdb                       0.9.31  ha17a0cc_1                  conda-forge                           Cached
  + lerc                        4.0.0  hbbae597_0                  conda-forge                           Cached
  + snappy                      1.2.1  h0c9a444_0                  conda-forge                           Cached
  + gmp                         6.3.0  h46f38da_0                  conda-forge                           Cached
  + libgfortran-ng             14.1.0  hfdc3801_1                  conda-forge                             52kB
  + libxcb                       1.15  h4194056_0                  conda-forge                            395kB
  + readline                      8.2  h0b9b154_1                  conda-forge                           Cached
  + zstd                        1.5.6  h03a2076_0                  conda-forge                           Cached
  + libpng                     1.6.43  hd4bbf49_0                  conda-forge                           Cached
  + libsqlite                  3.46.0  h4fdbfcb_0                  conda-forge                           Cached
  + zlib                       1.2.13  h1f2b957_6                  conda-forge                           Cached
  + tk                         8.6.13  hd4bbf49_0                  conda-forge                           Cached
  + leveldb                      1.23  h719eb63_2                  conda-forge                           Cached
  + mpfr                        4.2.1  haad2271_1                  conda-forge                           Cached
  + libtiff                     4.6.0  hcbea7e6_3                  conda-forge                            341kB
  + freetype                   2.12.1  h5baba08_2                  conda-forge                           Cached
  + mpc                         1.3.1  heaf1863_0                  conda-forge                           Cached
  + openjpeg                    2.5.2  h1c3486c_0                  conda-forge                            441kB
  + lcms2                        2.16  ha74cc02_0                  conda-forge                            323kB
  + tzdata                      2024a  h8827d51_1                  conda-forge                           Cached
  + numactl                    2.0.16  hba61f60_1                  ftp.osuosl.org/pub/open-ce/1.10.0     Cached
  + cudatoolkit                11.8.0  h36fe414_3                  ftp.osuosl.org/pub/open-ce/1.10.0      616MB
  + libprotobuf               3.21.12  h1776448_0                  ftp.osuosl.org/pub/open-ce/1.10.0     Cached
  + llvm-openmp                14.0.6  hc028133_0                  ftp.osuosl.org/pub/open-ce/1.10.0        1MB
  + nccl                       2.18.3  cuda11.8_1                  ftp.osuosl.org/pub/open-ce/1.10.0     Cached
  + cudnn                  8.9.2_11.8  h9ceb136_1                  ftp.osuosl.org/pub/open-ce/1.10.0     Cached
  + libopenblas                0.3.23  hc5a31fb_2                  ftp.osuosl.org/pub/open-ce/1.10.0        4MB
  + python                     3.11.9  hbe116a8_0_cpython          conda-forge                           Cached
  + libblas                     3.9.0  17_linuxppc64le_openblas    conda-forge                             15kB
  + libcblas                    3.9.0  17_linuxppc64le_openblas    conda-forge                             14kB
  + liblapack                   3.9.0  17_linuxppc64le_openblas    conda-forge                             15kB
  + wheel                      0.44.0  pyhd8ed1ab_0                conda-forge                           Cached
  + setuptools                 72.2.0  pyhd8ed1ab_0                conda-forge                           Cached
  + pip                          24.2  pyhd8ed1ab_0                conda-forge                           Cached
  + hyperframe                  6.0.1  pyhd8ed1ab_0                conda-forge                           Cached
  + hpack                       4.0.0  pyh9f0ad1d_0                conda-forge                           Cached
  + pysocks                     1.7.1  pyha2e5f31_6                conda-forge                           Cached
  + charset-normalizer          3.3.2  pyhd8ed1ab_0                conda-forge                           Cached
  + idna                          3.8  pyhd8ed1ab_0                conda-forge                             49kB
  + certifi                  2024.7.4  pyhd8ed1ab_0                conda-forge                           Cached
  + platformdirs                4.2.2  pyhd8ed1ab_0                conda-forge                           Cached
  + packaging                    24.1  pyhd8ed1ab_0                conda-forge                             50kB
  + pycparser                    2.22  pyhd8ed1ab_0                conda-forge                           Cached
  + mpmath                      1.3.0  pyhd8ed1ab_0                conda-forge                           Cached
  + typing_extensions          4.12.2  pyha770c72_0                conda-forge                           Cached
  + tabulate                   0.8.10  pyhd8ed1ab_0                conda-forge                           Cached
  + networkx                    2.8.8  pyhd8ed1ab_0                conda-forge                           Cached
  + filelock                   3.15.4  pyhd8ed1ab_0                conda-forge                           Cached
  + click                       8.1.7  unix_pyh707e725_0           conda-forge                           Cached
  + h2                          4.1.0  pyhd8ed1ab_0                conda-forge                           Cached
  + brotli-python               1.1.0  py311h83cebed_1             conda-forge                           Cached
  + pillow                     10.3.0  py311he6692c3_0             conda-forge                             42MB
  + markupsafe                  2.1.5  py311h32d8acf_0             conda-forge                           Cached
  + gmpy2                       2.1.5  py311h2758da7_1             conda-forge                           Cached
  + numpy                      1.24.3  py311hbc68021_0             conda-forge                           Cached
  + pyyaml                      6.0.2  py311hb02d432_0             conda-forge                            212kB
  + cffi                       1.15.1  py311h368c2b5_5             conda-forge                           Cached
  + zstandard                  0.23.0  py311h86462b8_0             conda-forge                            445kB
  + protobuf                  4.21.12  py311ha7baec7_1             ftp.osuosl.org/pub/open-ce/1.10.0     Cached
  + jinja2                      3.1.4  pyhd8ed1ab_0                conda-forge                           Cached
  + sympy                      1.13.2  pypyh2585a3b_103            conda-forge                              5MB
  + urllib3                     2.2.2  pyhd8ed1ab_1                conda-forge                           Cached
  + requests                   2.32.3  pyhd8ed1ab_0                conda-forge                           Cached
  + pooch                       1.8.2  pyhd8ed1ab_0                conda-forge                           Cached
  + scipy                      1.11.1  py311hd69e9bb_0             ftp.osuosl.org/pub/open-ce/1.10.0     Cached
  + pytorch-base                2.0.1  cuda11.8_py311_pb4.21.12_4  ftp.osuosl.org/pub/open-ce/1.10.0     Cached

mjdiff avatar Aug 28 '24 08:08 mjdiff