pipenv icon indicating copy to clipboard operation
pipenv copied to clipboard

Installing from git is broken

Open Bec-k opened this issue 10 months ago • 17 comments

Using latest pipenv v2023.9.1

  File "/home/beck/.pyenv/versions/3.11.4/lib/python3.11/site-packages/pipenv/project.py", line 1175, in generate_package_pipfile_entry
    entry["ref"] = vcs_parts[1].split("#", 1)[0].strip()
                   ~~~~~~~~~^^^
IndexError: list index out of range

I have printed vcs_parts and its content is: ['git+https://github.com/HazyResearch/flash-attention.git#subdirectory=csrc/rotary']

Bec-k avatar Sep 05 '23 08:09 Bec-k

ok, i checked your code, and i guess i got it. Had to add branch via @ in the url. this topic is closed

Bec-k avatar Sep 05 '23 08:09 Bec-k

Actually, i see that subdirectory is not correctly extracted from the provided url. Your code is expecting it to be provided from another source.

Bec-k avatar Sep 05 '23 08:09 Bec-k

                    vcs_parts = vcs_part.rsplit("@", 1)
                    print(vcs_parts)
                    entry["ref"] = vcs_parts[1].split("#", 1)[0].strip()
                    entry[vcs] = vcs_parts[0].strip()

                    # Check and extract subdirectory fragment
                    if package.link.subdirectory_fragment:
                        entry["subdirectory"] = package.link.subdirectory_fragment
                    break

Bec-k avatar Sep 05 '23 08:09 Bec-k

I'm getting this ['git+https://github.com/HazyResearch/flash-attention.git', 'main#subdirectory=csrc/rotary']

entry["ref"] = vcs_parts[1].split("#", 1)[0].strip() is removing everything after # , so subdirectory=csrc/rotary url part is discarded.

Bec-k avatar Sep 05 '23 08:09 Bec-k

How to specify that in the Pipfile? Like that? flash-attn = {git = "https://github.com/HazyResearch/flash-attention.git", subdirectory = "csrc/rotary", ref = "main"}

Bec-k avatar Sep 05 '23 10:09 Bec-k

There are a few things going on, but the one that blocks me from getting further is I also cannot install it using pip:

matte@LAPTOP-N5VSGIBD MINGW64 ~/Projects/pipenv-triage/torch
$ pip install git+https://github.com/HazyResearch/flash-attention.git@main#subdirectory=csrc/rotary -v --no-build-isolation
Using pip 23.2.1 from C:\Users\matte\AppData\Local\Programs\Python\Python311\Lib\site-packages\pip (python 3.11)
Collecting git+https://github.com/HazyResearch/flash-attention.git@main#subdirectory=csrc/rotary
  Cloning https://github.com/HazyResearch/flash-attention.git (to revision main) to c:\users\matte\appdata\local\temp\pip-req-build-kgzmad6q
  Running command git version
  git version 2.41.0.windows.1
  Running command git clone --filter=blob:none https://github.com/HazyResearch/flash-attention.git 'C:\Users\matte\AppData\Local\Temp\pip-req-build-kgzmad6q'
  Cloning into 'C:\Users\matte\AppData\Local\Temp\pip-req-build-kgzmad6q'...
  Updating files:   0% (2/396)
  Updating files:   1% (4/396)
  Updating files:   2% (8/396)
  Updating files:   3% (12/396)
  Updating files:   4% (16/396)
  Updating files:   5% (20/396)
  Updating files:   6% (24/396)
  Updating files:   7% (28/396)
  Updating files:   8% (32/396)
  Updating files:   9% (36/396)
  Updating files:  10% (40/396)
  Updating files:  11% (44/396)
  Updating files:  12% (48/396)
  Updating files:  13% (52/396)
  Updating files:  14% (56/396)
  Updating files:  15% (60/396)
  Updating files:  16% (64/396)
  Updating files:  17% (68/396)
  Updating files:  18% (72/396)
  Updating files:  19% (76/396)
  Updating files:  20% (80/396)
  Updating files:  21% (84/396)
  Updating files:  22% (88/396)
  Updating files:  23% (92/396)
  Updating files:  24% (96/396)
  Updating files:  25% (99/396)
  Updating files:  26% (103/396)
  Updating files:  27% (107/396)
  Updating files:  28% (111/396)
  Updating files:  29% (115/396)
  Updating files:  30% (119/396)
  Updating files:  31% (123/396)
  Updating files:  32% (127/396)
  Updating files:  33% (131/396)
  Updating files:  34% (135/396)
  Updating files:  35% (139/396)
  Updating files:  36% (143/396)
  Updating files:  37% (147/396)
  Updating files:  38% (151/396)
  Updating files:  39% (155/396)
  Updating files:  40% (159/396)
  Updating files:  41% (163/396)
  Updating files:  42% (167/396)
  Updating files:  43% (171/396)
  Updating files:  44% (175/396)
  Updating files:  45% (179/396)
  Updating files:  46% (183/396)
  Updating files:  47% (187/396)
  Updating files:  48% (191/396)
  Updating files:  49% (195/396)
  Updating files:  50% (198/396)
  Updating files:  51% (202/396)
  Updating files:  52% (206/396)
  Updating files:  53% (210/396)
  Updating files:  54% (214/396)
  Updating files:  55% (218/396)
  Updating files:  56% (222/396)
  Updating files:  57% (226/396)
  Updating files:  58% (230/396)
  Updating files:  59% (234/396)
  Updating files:  60% (238/396)
  Updating files:  61% (242/396)
  Updating files:  62% (246/396)
  Updating files:  63% (250/396)
  Updating files:  64% (254/396)
  Updating files:  65% (258/396)
  Updating files:  66% (262/396)
  Updating files:  67% (266/396)
  Updating files:  68% (270/396)
  Updating files:  69% (274/396)
  Updating files:  70% (278/396)
  Updating files:  71% (282/396)
  Updating files:  72% (286/396)
  Updating files:  73% (290/396)
  Updating files:  74% (294/396)
  Updating files:  75% (297/396)
  Updating files:  76% (301/396)
  Updating files:  77% (305/396)
  Updating files:  78% (309/396)
  Updating files:  79% (313/396)
  Updating files:  80% (317/396)
  Updating files:  81% (321/396)
  Updating files:  82% (325/396)
  Updating files:  83% (329/396)
  Updating files:  84% (333/396)
  Updating files:  85% (337/396)
  Updating files:  86% (341/396)
  Updating files:  87% (345/396)
  Updating files:  88% (349/396)
  Updating files:  89% (353/396)
  Updating files:  90% (357/396)
  Updating files:  91% (361/396)
  Updating files:  92% (365/396)
  Updating files:  93% (369/396)
  Updating files:  94% (373/396)
  Updating files:  95% (377/396)
  Updating files:  96% (381/396)
  Updating files:  97% (385/396)
  Updating files:  98% (389/396)
  Updating files:  99% (393/396)
  Updating files: 100% (396/396)
  Updating files: 100% (396/396), done.
  Running command git show-ref main
  913922cac57efd7c5e05f08155b37e74c427cf32 refs/heads/main
  913922cac57efd7c5e05f08155b37e74c427cf32 refs/remotes/origin/main
  Running command git symbolic-ref -q HEAD
  refs/heads/main
  Resolved https://github.com/HazyResearch/flash-attention.git to commit 913922cac57efd7c5e05f08155b37e74c427cf32
  Running command git submodule update --init --recursive -q
  Running command git rev-parse HEAD
  913922cac57efd7c5e05f08155b37e74c427cf32
  Running command python setup.py egg_info
  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "C:\Users\matte\AppData\Local\Temp\pip-req-build-kgzmad6q\csrc/rotary\setup.py", line 7, in <module>
      import torch
  ModuleNotFoundError: No module named 'torch'
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> See above for output.

  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: 'C:\Users\matte\AppData\Local\Programs\Python\Python311\python.exe' -c '
  exec(compile('"'"''"'"''"'"'
  # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
  #
  # - It imports setuptools before invoking setup.py, to enable projects that directly
  #   import from `distutils.core` to work with newer packaging standards.
  # - It provides a clear error message when setuptools is not installed.
  # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
  #   setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
  #     manifest_maker: standard file '"'"'-c'"'"' not found".
  # - It generates a shim setup.py, for handling setup.cfg-only projects.
  import os, sys, tokenize

  try:
      import setuptools
  except ImportError as error:
      print(
          "ERROR: Can not execute `setup.py` since setuptools is not available in "
          "the build environment.",
          file=sys.stderr,
      )
      sys.exit(1)

  __file__ = %r
  sys.argv[0] = __file__

  if os.path.exists(__file__):
      filename = __file__
      with tokenize.open(__file__) as f:
          setup_py_code = f.read()
  else:
      filename = "<auto-generated setuptools caller>"
      setup_py_code = "from setuptools import setup; setup()"

  exec(compile(setup_py_code, filename, "exec"))
  '"'"''"'"''"'"' % ('"'"'C:\\Users\\matte\\AppData\\Local\\Temp\\pip-req-build-kgzmad6q\\csrc/rotary\\setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' egg_info --egg-base 'C:\Users\matte\AppData\Local\Temp\pip-pip-egg-info-e936kl1t'
  cwd: C:\Users\matte\AppData\Local\Temp\pip-req-build-kgzmad6q\csrc/rotary
  Preparing metadata (setup.py) ... error
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Even if I have torch installed, I get this error -- probably because of the nature of build isolation isn't pulling from the site-packages when building the egg_info.

matteius avatar Sep 05 '23 15:09 matteius

You are missing pytorch package ModuleNotFoundError: No module named 'torch'

Bec-k avatar Sep 06 '23 09:09 Bec-k

As I said, I had installed torch right before that -- I believe the building of python setup.py egg_info is not considering other installed packages. Also you didn't answer my question -- can you actually install it with pip?

matteius avatar Sep 06 '23 12:09 matteius

Yes, i was able to install it, by removing that hash part from url.

Bec-k avatar Sep 06 '23 12:09 Bec-k

Yes, i was able to install it, by removing that hash part from url.

Do you mean the subdirectory fragment? If so, then you are technically not installing the same package, from what I can tell the parent setup.py excludes things in csrc directory among others. What version of torch are you using? I have torch==1.9.1+cu111 in my virtualenv to triage this project, but it seems to get ignored even when I run pipenv run pip install git+https://github.com/HazyResearch/flash-attention.git@main so its hard to tell -- if I remove the virtualenv and try to pip install --system then it finds my python 3.11 which doesn't have matching wheels for this version and this version appears to be the latest published windows torch in that repository.

matteius avatar Sep 06 '23 13:09 matteius

can confirm the issue, I'm using subdirectory in Pipfile and could not install package anymore using new pipenv Pipfile part:

packagename = { git = "https://github.com/<recacted>/<redacted>.git", editable = false, subdirectory = "<redacted>" }

exception:

File "<redacted>dependencies.py", line 773, in determine_package_name raise ValueError(f"Could not determine package name from {package}") ValueError: Could not determine package name from git+https://github.com/<redacted>/<redacted>.git#subdirectory=<redacted>

strufkin avatar Sep 06 '23 14:09 strufkin

@strufkin the sub-directory issue was fixed in 2023.9.1 so your issue is probably different and related to the ast parsing of the setup.py to determine package name. Without more details in new report for your issue, it will be hard to help, but there is an open PR that handles the case where the package name is an extrapolated variable but the string is still present in the setup.py

matteius avatar Sep 06 '23 14:09 matteius

@matteius Exactly my issue! Thank you for pointing to that PR!

strufkin avatar Sep 06 '23 14:09 strufkin

Worth checking against https://pypi.org/project/pipenv/2023.9.8/

matteius avatar Sep 08 '23 12:09 matteius

I can resolve it, but turns out I won't be able to install it because that repository does not yet support windows.

matte@LAPTOP-N5VSGIBD MINGW64 ~/Projects/pipenv-triage/issue-5913
$ cat Pipfile
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[[source]]
url = "https://download.pytorch.org/whl/cu118"
verify_ssl = true
name = "downloadpytorch"

[packages]
flash-attn = {git = "git+https://github.com/HazyResearch/flash-attention.git"}

[prereq]
packaging = "*"
einops = "*"
ninja = "*"
torch = {version = "==2.0.1", index = "downloadpytorch"}

[dev-packages]

[requires]
python_version = "3.9"

matte@LAPTOP-N5VSGIBD MINGW64 ~/Projects/pipenv-triage/issue-5913
$ cat Pipfile.lock
{
    "_meta": {
        "hash": {
            "sha256": "56ad888f2881ba0bd5d10b253acb89c0a127708f72d90ae4df07b7c138148e05"
        },
        "pipfile-spec": 6,
        "requires": {
            "python_version": "3.9"
        },
        "sources": [
            {
                "name": "pypi",
                "url": "https://pypi.org/simple",
                "verify_ssl": true
            },
            {
                "name": "downloadpytorch",
                "url": "https://download.pytorch.org/whl/cu118",
                "verify_ssl": true
            }
        ]
    },
    "default": {
        "einops": {
            "hashes": [
                "sha256:99149e46cc808956b174932fe563d920db4d6e5dadb8c6ecdaa7483b7ef7cfc3",
                "sha256:f95f8d00f4ded90dbc4b19b6f98b177332614b0357dde66997f3ae5d474dc8c8"
            ],
            "markers": "python_version >= '3.7'",
            "version": "==0.6.1"
        },
        "filelock": {
            "hashes": [
                "sha256:0ecc1dd2ec4672a10c8550a8182f1bd0c0a5088470ecd5a125e45f49472fac3d",
                "sha256:f067e40ccc40f2b48395a80fcbd4728262fab54e232e090a4063ab804179efeb"
            ],
            "markers": "python_version >= '3.8'",
            "version": "==3.12.3"
        },
        "flash-attn": {
            "git": "git+https://github.com/HazyResearch/flash-attention.git",
            "markers": "python_version >= '3.7'",
            "ref": "4c91621a5e0f1ec5cc36ccc23ceb18c1b41122bc"
        },
        "jinja2": {
            "hashes": [
                "sha256:31351a702a408a9e7595a8fc6150fc3f43bb6bf7e319770cbc0db9df9437e852",
                "sha256:6088930bfe239f0e6710546ab9c19c9ef35e29792895fed6e6e31a023a182a61"
            ],
            "markers": "python_version >= '3.7'",
            "version": "==3.1.2"
        },
        "markupsafe": {
            "hashes": [
                "sha256:05fb21170423db021895e1ea1e1f3ab3adb85d1c2333cbc2310f2a26bc77272e",
                "sha256:0a4e4a1aff6c7ac4cd55792abf96c915634c2b97e3cc1c7129578aa68ebd754e",
                "sha256:10bbfe99883db80bdbaff2dcf681dfc6533a614f700da1287707e8a5d78a8431",
                "sha256:134da1eca9ec0ae528110ccc9e48041e0828d79f24121a1a146161103c76e686",
                "sha256:14ff806850827afd6b07a5f32bd917fb7f45b046ba40c57abdb636674a8b559c",
                "sha256:1577735524cdad32f9f694208aa75e422adba74f1baee7551620e43a3141f559",
                "sha256:1b40069d487e7edb2676d3fbdb2b0829ffa2cd63a2ec26c4938b2d34391b4ecc",
                "sha256:1b8dd8c3fd14349433c79fa8abeb573a55fc0fdd769133baac1f5e07abf54aeb",
                "sha256:1f67c7038d560d92149c060157d623c542173016c4babc0c1913cca0564b9939",
                "sha256:282c2cb35b5b673bbcadb33a585408104df04f14b2d9b01d4c345a3b92861c2c",
                "sha256:2c1b19b3aaacc6e57b7e25710ff571c24d6c3613a45e905b1fde04d691b98ee0",
                "sha256:2ef12179d3a291be237280175b542c07a36e7f60718296278d8593d21ca937d4",
                "sha256:338ae27d6b8745585f87218a3f23f1512dbf52c26c28e322dbe54bcede54ccb9",
                "sha256:3c0fae6c3be832a0a0473ac912810b2877c8cb9d76ca48de1ed31e1c68386575",
                "sha256:3fd4abcb888d15a94f32b75d8fd18ee162ca0c064f35b11134be77050296d6ba",
                "sha256:42de32b22b6b804f42c5d98be4f7e5e977ecdd9ee9b660fda1a3edf03b11792d",
                "sha256:47d4f1c5f80fc62fdd7777d0d40a2e9dda0a05883ab11374334f6c4de38adffd",
                "sha256:504b320cd4b7eff6f968eddf81127112db685e81f7e36e75f9f84f0df46041c3",
                "sha256:525808b8019e36eb524b8c68acdd63a37e75714eac50e988180b169d64480a00",
                "sha256:56d9f2ecac662ca1611d183feb03a3fa4406469dafe241673d521dd5ae92a155",
                "sha256:5bbe06f8eeafd38e5d0a4894ffec89378b6c6a625ff57e3028921f8ff59318ac",
                "sha256:65c1a9bcdadc6c28eecee2c119465aebff8f7a584dd719facdd9e825ec61ab52",
                "sha256:68e78619a61ecf91e76aa3e6e8e33fc4894a2bebe93410754bd28fce0a8a4f9f",
                "sha256:69c0f17e9f5a7afdf2cc9fb2d1ce6aabdb3bafb7f38017c0b77862bcec2bbad8",
                "sha256:6b2b56950d93e41f33b4223ead100ea0fe11f8e6ee5f641eb753ce4b77a7042b",
                "sha256:715d3562f79d540f251b99ebd6d8baa547118974341db04f5ad06d5ea3eb8007",
                "sha256:787003c0ddb00500e49a10f2844fac87aa6ce977b90b0feaaf9de23c22508b24",
                "sha256:7ef3cb2ebbf91e330e3bb937efada0edd9003683db6b57bb108c4001f37a02ea",
                "sha256:8023faf4e01efadfa183e863fefde0046de576c6f14659e8782065bcece22198",
                "sha256:8758846a7e80910096950b67071243da3e5a20ed2546e6392603c096778d48e0",
                "sha256:8afafd99945ead6e075b973fefa56379c5b5c53fd8937dad92c662da5d8fd5ee",
                "sha256:8c41976a29d078bb235fea9b2ecd3da465df42a562910f9022f1a03107bd02be",
                "sha256:8e254ae696c88d98da6555f5ace2279cf7cd5b3f52be2b5cf97feafe883b58d2",
                "sha256:8f9293864fe09b8149f0cc42ce56e3f0e54de883a9de90cd427f191c346eb2e1",
                "sha256:9402b03f1a1b4dc4c19845e5c749e3ab82d5078d16a2a4c2cd2df62d57bb0707",
                "sha256:962f82a3086483f5e5f64dbad880d31038b698494799b097bc59c2edf392fce6",
                "sha256:9aad3c1755095ce347e26488214ef77e0485a3c34a50c5a5e2471dff60b9dd9c",
                "sha256:9dcdfd0eaf283af041973bff14a2e143b8bd64e069f4c383416ecd79a81aab58",
                "sha256:aa57bd9cf8ae831a362185ee444e15a93ecb2e344c8e52e4d721ea3ab6ef1823",
                "sha256:aa7bd130efab1c280bed0f45501b7c8795f9fdbeb02e965371bbef3523627779",
                "sha256:ab4a0df41e7c16a1392727727e7998a467472d0ad65f3ad5e6e765015df08636",
                "sha256:ad9e82fb8f09ade1c3e1b996a6337afac2b8b9e365f926f5a61aacc71adc5b3c",
                "sha256:af598ed32d6ae86f1b747b82783958b1a4ab8f617b06fe68795c7f026abbdcad",
                "sha256:b076b6226fb84157e3f7c971a47ff3a679d837cf338547532ab866c57930dbee",
                "sha256:b7ff0f54cb4ff66dd38bebd335a38e2c22c41a8ee45aa608efc890ac3e3931bc",
                "sha256:bfce63a9e7834b12b87c64d6b155fdd9b3b96191b6bd334bf37db7ff1fe457f2",
                "sha256:c011a4149cfbcf9f03994ec2edffcb8b1dc2d2aede7ca243746df97a5d41ce48",
                "sha256:c9c804664ebe8f83a211cace637506669e7890fec1b4195b505c214e50dd4eb7",
                "sha256:ca379055a47383d02a5400cb0d110cef0a776fc644cda797db0c5696cfd7e18e",
                "sha256:cb0932dc158471523c9637e807d9bfb93e06a95cbf010f1a38b98623b929ef2b",
                "sha256:cd0f502fe016460680cd20aaa5a76d241d6f35a1c3350c474bac1273803893fa",
                "sha256:ceb01949af7121f9fc39f7d27f91be8546f3fb112c608bc4029aef0bab86a2a5",
                "sha256:d080e0a5eb2529460b30190fcfcc4199bd7f827663f858a226a81bc27beaa97e",
                "sha256:dd15ff04ffd7e05ffcb7fe79f1b98041b8ea30ae9234aed2a9168b5797c3effb",
                "sha256:df0be2b576a7abbf737b1575f048c23fb1d769f267ec4358296f31c2479db8f9",
                "sha256:e09031c87a1e51556fdcb46e5bd4f59dfb743061cf93c4d6831bf894f125eb57",
                "sha256:e4dd52d80b8c83fdce44e12478ad2e85c64ea965e75d66dbeafb0a3e77308fcc",
                "sha256:f698de3fd0c4e6972b92290a45bd9b1536bffe8c6759c62471efaa8acb4c37bc",
                "sha256:fec21693218efe39aa7f8599346e90c705afa52c5b31ae019b2e57e8f6542bb2",
                "sha256:ffcc3f7c66b5f5b7931a5aa68fc9cecc51e685ef90282f4a82f0f5e9b704ad11"
            ],
            "markers": "python_version >= '3.7'",
            "version": "==2.1.3"
        },
        "mpmath": {
            "hashes": [
                "sha256:7a28eb2a9774d00c7bc92411c19a89209d5da7c4c9a9e227be8330a23a25b91f",
                "sha256:a0b2b9fe80bbcd81a6647ff13108738cfb482d481d826cc0e02f5b35e5c88d2c"
            ],
            "version": "==1.3.0"
        },
        "networkx": {
            "hashes": [
                "sha256:4f33f68cb2afcf86f28a45f43efc27a9386b535d567d2127f8f61d51dec58d36",
                "sha256:de346335408f84de0eada6ff9fafafff9bcda11f0a0dfaa931133debb146ab61"
            ],
            "markers": "python_version >= '3.8'",
            "version": "==3.1"
        },
        "ninja": {
            "hashes": [
                "sha256:1c474326e11fba3f8c2582715d79216292e327d3335367c0e87e9647a002cc4a",
                "sha256:3329b4b7c1694730772522a3ba0ba40fd15c012476ed3e1c9f0fd9e76190394e",
                "sha256:34753459493543782d87267e4cad63dd4639b07f8394ffe6d4417e9eda05c8a8",
                "sha256:3b28b595ed580752240ade7821b6cb7a5a4c6a604c865dc474bd38f06e2eb7f5",
                "sha256:4e547bc759c570773d83d110c41fd5ca9a94c0a9a8388f5a3ea37bdf97d002b0",
                "sha256:60179bb4f22c88279c53a5402bb5fe81c97c627a28d93c737d1fa067d892115d",
                "sha256:642cb64d859276998f14972724850e0c5b7febbc1bce3d2065b7e0cb7d3a0b79",
                "sha256:6f6465a7efe6473a2a34edab83633594de19d59406a727316e1367ebcc528908",
                "sha256:779f228e407c54a8b6e4cbf8f835489998dd250f67bf1b9bd7b8a8ab6bdcdc7b",
                "sha256:817e2aee2a4d28a708a67bcfba1817ae502c32c6d8ef80e50d63b0f23adf3a08",
                "sha256:8cf96f92ccc851c600cb3e1251c34db06f1dd682de79188ad490c33cddc66981",
                "sha256:a7a564fe755ddfbdbccb07b0b758e3f8460e5f8ba1adaab40a5eaa2f8c01ce68",
                "sha256:ba50a32424912e5f3ee40d791b506a160dc0eeda7de5ad8faebe7aa8006244dc",
                "sha256:c833a47d39b2d1eee3f9ca886fa1581efd5be6068b82734ac229961ee8748f90",
                "sha256:df11b8afea0501883e33faeb1c43d2ef67f466d5f4bd85f9c376e9a93a43a277",
                "sha256:edec1053e141253076b2df7ec03a246ff581e9270aa1ca9759397b21e2760e57",
                "sha256:f48c3c6eea204062f6bbf089dfc63e1ad41a08640e1da46ef2b30fa426f7ce23"
            ],
            "version": "==1.11.1"
        },
        "packaging": {
            "hashes": [
                "sha256:994793af429502c4ea2ebf6bf664629d07c1a9fe974af92966e4b8d2df7edc61",
                "sha256:a392980d2b6cffa644431898be54b0045151319d1e7ec34f0cfed48767dd334f"
            ],
            "markers": "python_version >= '3.7'",
            "version": "==23.1"
        },
        "sympy": {
            "hashes": [
                "sha256:c3588cd4295d0c0f603d0f2ae780587e64e2efeedb3521e46b9bb1d08d184fa5",
                "sha256:ebf595c8dac3e0fdc4152c51878b498396ec7f30e7a914d6071e674d49420fb8"
            ],
            "markers": "python_version >= '3.8'",
            "version": "==1.12"
        },
        "torch": {
            "hashes": [
                "sha256:0882243755ff28895e8e6dc6bc26ebcf5aa0911ed81b2a12f241fc4b09075b13",
                "sha256:1adb60d369f2650cac8e9a95b1d5758e25d526a34808f7448d0bd599e4ae9072",
                "sha256:1bcffc16b89e296826b33b98db5166f990e3b72654a2b90673e817b16c50e32b",
                "sha256:25aa43ca80dcdf32f13da04c503ec7afdf8e77e3a0183dd85cd3e53b2842e527",
                "sha256:359bfaad94d1cda02ab775dc1cc386d585712329bb47b8741607ef6ef4950747",
                "sha256:423e0ae257b756bb45a4b49072046772d1ad0c592265c5080070e0767da4e490",
                "sha256:567f84d657edc5582d716900543e6e62353dbe275e61cdc36eda4929e46df9e7",
                "sha256:5ef3ea3d25441d3957348f7e99c7824d33798258a2bf5f0f0277cbcadad2e20d",
                "sha256:671a2565e3f63b8fe8e42ae3e36ad249fe5e567435ea27b94edaa672a7d0c416",
                "sha256:787b5a78aa7917465e9b96399b883920c88a08f4eb63b5a5d2d1a16e27d2f89b",
                "sha256:7c84e44d9002182edd859f3400deaa7410f5ec948a519cc7ef512c2f9b34d2c4",
                "sha256:8742bdc62946c93f75ff92da00e3803216c6cce9b132fbca69664ca38cfb3e18",
                "sha256:8ced00b3ba471856b993822508f77c98f48a458623596a4c43136158781e306a",
                "sha256:b6019b1de4978e96daa21d6a3ebb41e88a0b474898fe251fd96189587408873e",
                "sha256:c62df99352bd6ee5a5a8d1832452110435d178b5164de450831a3a8cc14dc680",
                "sha256:dbd68cbd1cd9da32fe5d294dd3411509b3d841baecb780b38b3b7b06c7754434",
                "sha256:e10e1597f2175365285db1b24019eb6f04d53dcd626c735fc502f1e8b6be9875",
                "sha256:e617b1d0abaf6ced02dbb9486803abfef0d581609b09641b34fa315c9c40766d",
                "sha256:ef654427d91600129864644e35deea761fb1fe131710180b952a6f2e2207075e",
                "sha256:f66aa6b9580a22b04d0af54fcd042f52406a8479e2b6a550e3d9f95963e168c8"
            ],
            "markers": "python_full_version >= '3.8.0'",
            "version": "==2.0.1"
        },
        "typing-extensions": {
            "hashes": [
                "sha256:440d5dd3af93b060174bf433bccd69b0babc3b15b1a8dca43789fd7f61514b36",
                "sha256:b75ddc264f0ba5615db7ba217daeb99701ad295353c45f9e95963337ceeeffb2"
            ],
            "markers": "python_version >= '3.7'",
            "version": "==4.7.1"
        }
    },
    "develop": {},
    "prereq": {
        "einops": {
            "hashes": [
                "sha256:99149e46cc808956b174932fe563d920db4d6e5dadb8c6ecdaa7483b7ef7cfc3",
                "sha256:f95f8d00f4ded90dbc4b19b6f98b177332614b0357dde66997f3ae5d474dc8c8"
            ],
            "index": "pypi",
            "markers": "python_version >= '3.7'",
            "version": "==0.6.1"
        },
        "filelock": {
            "hashes": [
                "sha256:0ecc1dd2ec4672a10c8550a8182f1bd0c0a5088470ecd5a125e45f49472fac3d",
                "sha256:f067e40ccc40f2b48395a80fcbd4728262fab54e232e090a4063ab804179efeb"
            ],
            "markers": "python_version >= '3.8'",
            "version": "==3.12.3"
        },
        "jinja2": {
            "hashes": [
                "sha256:31351a702a408a9e7595a8fc6150fc3f43bb6bf7e319770cbc0db9df9437e852",
                "sha256:6088930bfe239f0e6710546ab9c19c9ef35e29792895fed6e6e31a023a182a61"
            ],
            "markers": "python_version >= '3.7'",
            "version": "==3.1.2"
        },
        "markupsafe": {
            "hashes": [
                "sha256:05fb21170423db021895e1ea1e1f3ab3adb85d1c2333cbc2310f2a26bc77272e",
                "sha256:0a4e4a1aff6c7ac4cd55792abf96c915634c2b97e3cc1c7129578aa68ebd754e",
                "sha256:10bbfe99883db80bdbaff2dcf681dfc6533a614f700da1287707e8a5d78a8431",
                "sha256:134da1eca9ec0ae528110ccc9e48041e0828d79f24121a1a146161103c76e686",
                "sha256:14ff806850827afd6b07a5f32bd917fb7f45b046ba40c57abdb636674a8b559c",
                "sha256:1577735524cdad32f9f694208aa75e422adba74f1baee7551620e43a3141f559",
                "sha256:1b40069d487e7edb2676d3fbdb2b0829ffa2cd63a2ec26c4938b2d34391b4ecc",
                "sha256:1b8dd8c3fd14349433c79fa8abeb573a55fc0fdd769133baac1f5e07abf54aeb",
                "sha256:1f67c7038d560d92149c060157d623c542173016c4babc0c1913cca0564b9939",
                "sha256:282c2cb35b5b673bbcadb33a585408104df04f14b2d9b01d4c345a3b92861c2c",
                "sha256:2c1b19b3aaacc6e57b7e25710ff571c24d6c3613a45e905b1fde04d691b98ee0",
                "sha256:2ef12179d3a291be237280175b542c07a36e7f60718296278d8593d21ca937d4",
                "sha256:338ae27d6b8745585f87218a3f23f1512dbf52c26c28e322dbe54bcede54ccb9",
                "sha256:3c0fae6c3be832a0a0473ac912810b2877c8cb9d76ca48de1ed31e1c68386575",
                "sha256:3fd4abcb888d15a94f32b75d8fd18ee162ca0c064f35b11134be77050296d6ba",
                "sha256:42de32b22b6b804f42c5d98be4f7e5e977ecdd9ee9b660fda1a3edf03b11792d",
                "sha256:47d4f1c5f80fc62fdd7777d0d40a2e9dda0a05883ab11374334f6c4de38adffd",
                "sha256:504b320cd4b7eff6f968eddf81127112db685e81f7e36e75f9f84f0df46041c3",
                "sha256:525808b8019e36eb524b8c68acdd63a37e75714eac50e988180b169d64480a00",
                "sha256:56d9f2ecac662ca1611d183feb03a3fa4406469dafe241673d521dd5ae92a155",
                "sha256:5bbe06f8eeafd38e5d0a4894ffec89378b6c6a625ff57e3028921f8ff59318ac",
                "sha256:65c1a9bcdadc6c28eecee2c119465aebff8f7a584dd719facdd9e825ec61ab52",
                "sha256:68e78619a61ecf91e76aa3e6e8e33fc4894a2bebe93410754bd28fce0a8a4f9f",
                "sha256:69c0f17e9f5a7afdf2cc9fb2d1ce6aabdb3bafb7f38017c0b77862bcec2bbad8",
                "sha256:6b2b56950d93e41f33b4223ead100ea0fe11f8e6ee5f641eb753ce4b77a7042b",
                "sha256:715d3562f79d540f251b99ebd6d8baa547118974341db04f5ad06d5ea3eb8007",
                "sha256:787003c0ddb00500e49a10f2844fac87aa6ce977b90b0feaaf9de23c22508b24",
                "sha256:7ef3cb2ebbf91e330e3bb937efada0edd9003683db6b57bb108c4001f37a02ea",
                "sha256:8023faf4e01efadfa183e863fefde0046de576c6f14659e8782065bcece22198",
                "sha256:8758846a7e80910096950b67071243da3e5a20ed2546e6392603c096778d48e0",
                "sha256:8afafd99945ead6e075b973fefa56379c5b5c53fd8937dad92c662da5d8fd5ee",
                "sha256:8c41976a29d078bb235fea9b2ecd3da465df42a562910f9022f1a03107bd02be",
                "sha256:8e254ae696c88d98da6555f5ace2279cf7cd5b3f52be2b5cf97feafe883b58d2",
                "sha256:8f9293864fe09b8149f0cc42ce56e3f0e54de883a9de90cd427f191c346eb2e1",
                "sha256:9402b03f1a1b4dc4c19845e5c749e3ab82d5078d16a2a4c2cd2df62d57bb0707",
                "sha256:962f82a3086483f5e5f64dbad880d31038b698494799b097bc59c2edf392fce6",
                "sha256:9aad3c1755095ce347e26488214ef77e0485a3c34a50c5a5e2471dff60b9dd9c",
                "sha256:9dcdfd0eaf283af041973bff14a2e143b8bd64e069f4c383416ecd79a81aab58",
                "sha256:aa57bd9cf8ae831a362185ee444e15a93ecb2e344c8e52e4d721ea3ab6ef1823",
                "sha256:aa7bd130efab1c280bed0f45501b7c8795f9fdbeb02e965371bbef3523627779",
                "sha256:ab4a0df41e7c16a1392727727e7998a467472d0ad65f3ad5e6e765015df08636",
                "sha256:ad9e82fb8f09ade1c3e1b996a6337afac2b8b9e365f926f5a61aacc71adc5b3c",
                "sha256:af598ed32d6ae86f1b747b82783958b1a4ab8f617b06fe68795c7f026abbdcad",
                "sha256:b076b6226fb84157e3f7c971a47ff3a679d837cf338547532ab866c57930dbee",
                "sha256:b7ff0f54cb4ff66dd38bebd335a38e2c22c41a8ee45aa608efc890ac3e3931bc",
                "sha256:bfce63a9e7834b12b87c64d6b155fdd9b3b96191b6bd334bf37db7ff1fe457f2",
                "sha256:c011a4149cfbcf9f03994ec2edffcb8b1dc2d2aede7ca243746df97a5d41ce48",
                "sha256:c9c804664ebe8f83a211cace637506669e7890fec1b4195b505c214e50dd4eb7",
                "sha256:ca379055a47383d02a5400cb0d110cef0a776fc644cda797db0c5696cfd7e18e",
                "sha256:cb0932dc158471523c9637e807d9bfb93e06a95cbf010f1a38b98623b929ef2b",
                "sha256:cd0f502fe016460680cd20aaa5a76d241d6f35a1c3350c474bac1273803893fa",
                "sha256:ceb01949af7121f9fc39f7d27f91be8546f3fb112c608bc4029aef0bab86a2a5",
                "sha256:d080e0a5eb2529460b30190fcfcc4199bd7f827663f858a226a81bc27beaa97e",
                "sha256:dd15ff04ffd7e05ffcb7fe79f1b98041b8ea30ae9234aed2a9168b5797c3effb",
                "sha256:df0be2b576a7abbf737b1575f048c23fb1d769f267ec4358296f31c2479db8f9",
                "sha256:e09031c87a1e51556fdcb46e5bd4f59dfb743061cf93c4d6831bf894f125eb57",
                "sha256:e4dd52d80b8c83fdce44e12478ad2e85c64ea965e75d66dbeafb0a3e77308fcc",
                "sha256:f698de3fd0c4e6972b92290a45bd9b1536bffe8c6759c62471efaa8acb4c37bc",
                "sha256:fec21693218efe39aa7f8599346e90c705afa52c5b31ae019b2e57e8f6542bb2",
                "sha256:ffcc3f7c66b5f5b7931a5aa68fc9cecc51e685ef90282f4a82f0f5e9b704ad11"
            ],
            "markers": "python_version >= '3.7'",
            "version": "==2.1.3"
        },
        "mpmath": {
            "hashes": [
                "sha256:7a28eb2a9774d00c7bc92411c19a89209d5da7c4c9a9e227be8330a23a25b91f",
                "sha256:a0b2b9fe80bbcd81a6647ff13108738cfb482d481d826cc0e02f5b35e5c88d2c"
            ],
            "version": "==1.3.0"
        },
        "networkx": {
            "hashes": [
                "sha256:4f33f68cb2afcf86f28a45f43efc27a9386b535d567d2127f8f61d51dec58d36",
                "sha256:de346335408f84de0eada6ff9fafafff9bcda11f0a0dfaa931133debb146ab61"
            ],
            "markers": "python_version >= '3.8'",
            "version": "==3.1"
        },
        "ninja": {
            "hashes": [
                "sha256:1c474326e11fba3f8c2582715d79216292e327d3335367c0e87e9647a002cc4a",
                "sha256:3329b4b7c1694730772522a3ba0ba40fd15c012476ed3e1c9f0fd9e76190394e",
                "sha256:34753459493543782d87267e4cad63dd4639b07f8394ffe6d4417e9eda05c8a8",
                "sha256:3b28b595ed580752240ade7821b6cb7a5a4c6a604c865dc474bd38f06e2eb7f5",
                "sha256:4e547bc759c570773d83d110c41fd5ca9a94c0a9a8388f5a3ea37bdf97d002b0",
                "sha256:60179bb4f22c88279c53a5402bb5fe81c97c627a28d93c737d1fa067d892115d",
                "sha256:642cb64d859276998f14972724850e0c5b7febbc1bce3d2065b7e0cb7d3a0b79",
                "sha256:6f6465a7efe6473a2a34edab83633594de19d59406a727316e1367ebcc528908",
                "sha256:779f228e407c54a8b6e4cbf8f835489998dd250f67bf1b9bd7b8a8ab6bdcdc7b",
                "sha256:817e2aee2a4d28a708a67bcfba1817ae502c32c6d8ef80e50d63b0f23adf3a08",
                "sha256:8cf96f92ccc851c600cb3e1251c34db06f1dd682de79188ad490c33cddc66981",
                "sha256:a7a564fe755ddfbdbccb07b0b758e3f8460e5f8ba1adaab40a5eaa2f8c01ce68",
                "sha256:ba50a32424912e5f3ee40d791b506a160dc0eeda7de5ad8faebe7aa8006244dc",
                "sha256:c833a47d39b2d1eee3f9ca886fa1581efd5be6068b82734ac229961ee8748f90",
                "sha256:df11b8afea0501883e33faeb1c43d2ef67f466d5f4bd85f9c376e9a93a43a277",
                "sha256:edec1053e141253076b2df7ec03a246ff581e9270aa1ca9759397b21e2760e57",
                "sha256:f48c3c6eea204062f6bbf089dfc63e1ad41a08640e1da46ef2b30fa426f7ce23"
            ],
            "index": "pypi",
            "version": "==1.11.1"
        },
        "packaging": {
            "hashes": [
                "sha256:994793af429502c4ea2ebf6bf664629d07c1a9fe974af92966e4b8d2df7edc61",
                "sha256:a392980d2b6cffa644431898be54b0045151319d1e7ec34f0cfed48767dd334f"
            ],
            "index": "pypi",
            "markers": "python_version >= '3.7'",
            "version": "==23.1"
        },
        "sympy": {
            "hashes": [
                "sha256:c3588cd4295d0c0f603d0f2ae780587e64e2efeedb3521e46b9bb1d08d184fa5",
                "sha256:ebf595c8dac3e0fdc4152c51878b498396ec7f30e7a914d6071e674d49420fb8"
            ],
            "markers": "python_version >= '3.8'",
            "version": "==1.12"
        },
        "torch": {
            "hashes": [
                "sha256:143b6c658c17d43376e2dfbaa2c106d35639d615e5e8dec4429cf1e510dd8d61",
                "sha256:2ce38a6e4ea7c4b7f5baa51e65243a5f687f6e19ab7915ba5b2a431105f50bbe",
                "sha256:a7a49d459bf4862f64f7bc1a68beccf8881c2fa9f3e0569608e16ba6f85ebf7b",
                "sha256:b663a4ee744d574095dbd612644de345944247c0605692309fd9f6c7ccdea022",
                "sha256:e58d26a11bd57ac19761c018c3151c15bc71d068afc8ec409bfd9b4cfcc63a52",
                "sha256:eb55f29db5744eda8a96f5594e637daed0d52278273005de759970e67cfa6a5a",
                "sha256:f58d75619bc96e4322343c030b893613701caa2d6db8017155da226c14171335",
                "sha256:fa225b6f941ee0e78978ac85ed7744d3c19fff462473821f8060c14faa60043e"
            ],
            "index": "downloadpytorch",
            "markers": "python_full_version >= '3.8.0'",
            "version": "==2.0.1+cu118"
        },
        "typing-extensions": {
            "hashes": [
                "sha256:440d5dd3af93b060174bf433bccd69b0babc3b15b1a8dca43789fd7f61514b36",
                "sha256:b75ddc264f0ba5615db7ba217daeb99701ad295353c45f9e95963337ceeeffb2"
            ],
            "markers": "python_version >= '3.7'",
            "version": "==4.7.1"
        }
    }
}

matteius avatar Sep 09 '23 17:09 matteius

In the above example, pipenv sync --categories="prereq default"

matteius avatar Sep 09 '23 17:09 matteius

@Bec-k have you had a chance to try the most recent pipenv version or my suggestions? Unfortunately this dependency both requires CUDA (which I have on my host OS) but doesn't support windows (my host OS) so its quite limiting for me to be able to provide support and I am certain the title of the issue doesn't reflect reality -- in general installing from git is working well.

This is perhaps an edge case of that, and we had broke sub directory fragments at one point in August, but that has since been fixed. I am willing to leave this open if we update the title and get some updates on what specifically is still not working, but right now I can't push it any further.

matteius avatar Sep 12 '23 11:09 matteius