ERROR: Failed building wheel for hnswlib Failed to build hnswlib ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects
Dear guys, I just cannot install the requirements well because of the error message I typed in the topic "
-
error: subprocess-exited-with-error × Building wheel for hnswlib (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [12 lines of output]
-
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\include\yvals.h(17): fatal error C1083: cannot open include file: 'crtdbg.h': No such file or directory error: command 'C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\bin\HostX86\x64\cl.exe' failed with exit code 2 [end of output]
-
ERROR: Failed building wheel for hnswlib Failed to build hnswlib ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects"
Thanks a lot if any discussions about possibilities to solve these problems!
Environment (please complete the following information):
- OS / hardware: windows 10
- Python version 3.10.10
PS C:\Users\User\priate gpt\privateGPT> pip install -r requirements.txt
Collecting langchain==0.0.171 (from -r requirements.txt (line 1))
Using cached langchain-0.0.171-py3-none-any.whl (846 kB)
Collecting pygpt4all==1.1.0 (from -r requirements.txt (line 2))
Using cached pygpt4all-1.1.0-py3-none-any.whl
Collecting chromadb==0.3.23 (from -r requirements.txt (line 3))
Using cached chromadb-0.3.23-py3-none-any.whl (71 kB)
Collecting llama-cpp-python==0.1.50 (from -r requirements.txt (line 4))
Using cached llama_cpp_python-0.1.50-cp310-cp310-win_amd64.whl
Collecting urllib3==2.0.2 (from -r requirements.txt (line 5))
Using cached urllib3-2.0.2-py3-none-any.whl (123 kB)
Collecting pdfminer.six==20221105 (from -r requirements.txt (line 6))
Using cached pdfminer.six-20221105-py3-none-any.whl (5.6 MB)
Requirement already satisfied: python-dotenv==1.0.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 7)) (1.0.0)
Collecting unstructured==0.6.6 (from -r requirements.txt (line 8))
Using cached unstructured-0.6.6-py3-none-any.whl (1.3 MB)
Collecting extract-msg==0.41.1 (from -r requirements.txt (line 9))
Using cached extract_msg-0.41.1-py2.py3-none-any.whl (184 kB)
Collecting tabulate==0.9.0 (from -r requirements.txt (line 10))
Using cached tabulate-0.9.0-py3-none-any.whl (35 kB)
Collecting pandoc==2.3 (from -r requirements.txt (line 11))
Using cached pandoc-2.3-py3-none-any.whl
Collecting pypandoc==1.11 (from -r requirements.txt (line 12))
Using cached pypandoc-1.11-py3-none-any.whl (20 kB)
Requirement already satisfied: PyYAML>=5.4.1 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from langchain==0.0.171->-r requirements.txt (line 1)) (6.0)
Collecting SQLAlchemy<3,>=1.4 (from langchain==0.0.171->-r requirements.txt (line 1))
Using cached SQLAlchemy-2.0.14-cp310-cp310-win_amd64.whl (2.0 MB)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from langchain==0.0.171->-r requirements.txt (line 1)) (3.8.4)
Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from langchain==0.0.171->-r requirements.txt (line 1)) (4.0.2)
Collecting dataclasses-json<0.6.0,>=0.5.7 (from langchain==0.0.171->-r requirements.txt (line 1)) Using cached dataclasses_json-0.5.7-py3-none-any.whl (25 kB)
Collecting numexpr<3.0.0,>=2.8.4 (from langchain==0.0.171->-r requirements.txt (line 1))
Using cached numexpr-2.8.4-cp310-cp310-win_amd64.whl (92 kB)
Requirement already satisfied: numpy<2,>=1 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from langchain==0.0.171->-r requirements.txt (line 1)) (1.24.2)
Collecting openapi-schema-pydantic<2.0,>=1.2 (from langchain==0.0.171->-r requirements.txt (line
1))
Using cached openapi_schema_pydantic-1.2.4-py3-none-any.whl (90 kB)
Collecting pydantic<2,>=1 (from langchain==0.0.171->-r requirements.txt (line 1))
Using cached pydantic-1.10.7-cp310-cp310-win_amd64.whl (2.1 MB)
Requirement already satisfied: requests<3,>=2 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from langchain==0.0.171->-r requirements.txt (line 1)) (2.28.2)
Collecting tenacity<9.0.0,>=8.1.0 (from langchain==0.0.171->-r requirements.txt (line 1))
Using cached tenacity-8.2.2-py3-none-any.whl (24 kB)
Collecting pyllamacpp (from pygpt4all==1.1.0->-r requirements.txt (line 2))
Using cached pyllamacpp-2.2.0-cp310-cp310-win_amd64.whl (266 kB)
Collecting pygptj (from pygpt4all==1.1.0->-r requirements.txt (line 2))
Using cached pygptj-2.0.3-cp310-cp310-win_amd64.whl (180 kB)
Requirement already satisfied: pandas>=1.3 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from chromadb==0.3.23->-r requirements.txt (line 3)) (2.0.1)
Collecting hnswlib>=0.7 (from chromadb==0.3.23->-r requirements.txt (line 3))
Using cached hnswlib-0.7.0.tar.gz (33 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting clickhouse-connect>=0.5.7 (from chromadb==0.3.23->-r requirements.txt (line 3))
Using cached clickhouse_connect-0.5.24-cp310-cp310-win_amd64.whl (222 kB)
Collecting sentence-transformers>=2.2.2 (from chromadb==0.3.23->-r requirements.txt (line 3))
Using cached sentence_transformers-2.2.2-py3-none-any.whl
Collecting duckdb>=0.7.1 (from chromadb==0.3.23->-r requirements.txt (line 3))
Using cached duckdb-0.8.0-cp310-cp310-win_amd64.whl (9.8 MB)
Collecting fastapi>=0.85.1 (from chromadb==0.3.23->-r requirements.txt (line 3))
Using cached fastapi-0.95.2-py3-none-any.whl (56 kB)
Collecting uvicorn[standard]>=0.18.3 (from chromadb==0.3.23->-r requirements.txt (line 3))
Using cached uvicorn-0.22.0-py3-none-any.whl (58 kB)
Collecting posthog>=2.4.0 (from chromadb==0.3.23->-r requirements.txt (line 3))
Using cached posthog-3.0.1-py2.py3-none-any.whl (37 kB)
Requirement already satisfied: typing-extensions>=4.5.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from chromadb==0.3.23->-r requirements.txt (line 3)) (4.5.0)
Requirement already satisfied: charset-normalizer>=2.0.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from pdfminer.six==20221105->-r requirements.txt (line 6)) (3.1.0)
Collecting cryptography>=36.0.0 (from pdfminer.six==20221105->-r requirements.txt (line 6))
Using cached cryptography-40.0.2-cp36-abi3-win_amd64.whl (2.6 MB)
Collecting argilla (from unstructured==0.6.6->-r requirements.txt (line 8))
Using cached argilla-1.7.0-py3-none-any.whl (2.2 MB)
Requirement already satisfied: lxml in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from unstructured==0.6.6->-r requirements.txt (line 8)) (4.9.2)
Collecting msg-parser (from unstructured==0.6.6->-r requirements.txt (line 8))
Using cached msg_parser-1.2.0-py2.py3-none-any.whl (101 kB)
Requirement already satisfied: nltk in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from unstructured==0.6.6->-r requirements.txt (line 8)) (3.8.1)
Requirement already satisfied: openpyxl in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from unstructured==0.6.6->-r requirements.txt (line 8)) (3.1.2)
Requirement already satisfied: pillow in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from unstructured==0.6.6->-r requirements.txt (line 8)) (9.5.0)
Collecting python-docx (from unstructured==0.6.6->-r requirements.txt (line 8))
Using cached python_docx-0.8.11-py3-none-any.whl
Collecting python-pptx (from unstructured==0.6.6->-r requirements.txt (line 8))
Using cached python_pptx-0.6.21-py3-none-any.whl
Collecting python-magic (from unstructured==0.6.6->-r requirements.txt (line 8))
Using cached python_magic-0.4.27-py2.py3-none-any.whl (13 kB)
Collecting markdown (from unstructured==0.6.6->-r requirements.txt (line 8))
Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Requirement already satisfied: certifi>=2022.12.07 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from unstructured==0.6.6->-r requirements.txt (line 8)) (2022.12.7)Collecting imapclient<3,>=2.3.0 (from extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached IMAPClient-2.3.1-py2.py3-none-any.whl (181 kB)
Collecting olefile==0.46 (from extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached olefile-0.46-py2.py3-none-any.whl
Collecting tzlocal==4.2 (from extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached tzlocal-4.2-py3-none-any.whl (19 kB)
Collecting compressed-rtf==1.0.6 (from extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached compressed_rtf-1.0.6-py3-none-any.whl
Collecting ebcdic==1.1.1 (from extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached ebcdic-1.1.1-py2.py3-none-any.whl (128 kB)
Requirement already satisfied: beautifulsoup4<4.13,>=4.11.1 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from extract-msg==0.41.1->-r requirements.txt (line 9)) (4.12.2)
Collecting RTFDE==0.0.2 (from extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached RTFDE-0.0.2-py3-none-any.whl (34 kB)
Requirement already satisfied: chardet<6,>=4.0.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from extract-msg==0.41.1->-r requirements.txt (line 9)) (5.1.0)
Collecting red-black-tree-mod==1.20 (from extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached red_black_tree_mod-1.20-py3-none-any.whl
Collecting plumbum (from pandoc==2.3->-r requirements.txt (line 11))
Using cached plumbum-1.8.1-py3-none-any.whl (126 kB)
Collecting ply (from pandoc==2.3->-r requirements.txt (line 11))
Using cached ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting lark-parser>=0.11 (from RTFDE==0.0.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached lark_parser-0.12.0-py2.py3-none-any.whl (103 kB)
Collecting oletools>=0.56 (from RTFDE==0.0.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached oletools-0.60.1-py2.py3-none-any.whl (977 kB)
Collecting pytz-deprecation-shim (from tzlocal==4.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached pytz_deprecation_shim-0.1.0.post0-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: tzdata in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from tzlocal==4.2->extract-msg==0.41.1->-r requirements.txt (line 9)) (2023.3)
Requirement already satisfied: attrs>=17.3.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.171->-r requirements.txt (line 1)) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.171->-r requirements.txt (line 1)) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.171->-r requirements.txt (line 1)) (1.8.2)
Requirement already satisfied: frozenlist>=1.1.1 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.171->-r requirements.txt (line 1)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.171->-r requirements.txt (line 1)) (1.3.1)
Requirement already satisfied: soupsieve>1.2 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from beautifulsoup4<4.13,>=4.11.1->extract-msg==0.41.1->-r requirements.txt (line 9)) (2.4.1)
Requirement already satisfied: pytz in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from clickhouse-connect>=0.5.7->chromadb==0.3.23->-r requirements.txt (line 3)) (2023.3)
Collecting zstandard (from clickhouse-connect>=0.5.7->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached zstandard-0.21.0-cp310-cp310-win_amd64.whl (511 kB)
Collecting lz4 (from clickhouse-connect>=0.5.7->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached lz4-4.3.2-cp310-cp310-win_amd64.whl (99 kB)
Requirement already satisfied: cffi>=1.12 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from cryptography>=36.0.0->pdfminer.six==20221105->-r requirements.txt (line 6)) (1.15.1)
Collecting marshmallow<4.0.0,>=3.3.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.171->-r requirements.txt (line 1))
Using cached marshmallow-3.19.0-py3-none-any.whl (49 kB)
Collecting marshmallow-enum<2.0.0,>=1.5.1 (from dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.171->-r requirements.txt (line 1))
Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
Collecting typing-inspect>=0.4.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.171->-r requirements.txt (line 1))
Using cached typing_inspect-0.8.0-py3-none-any.whl (8.7 kB)
Collecting starlette<0.28.0,>=0.27.0 (from fastapi>=0.85.1->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached starlette-0.27.0-py3-none-any.whl (66 kB)
Requirement already satisfied: six in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from imapclient<3,>=2.3.0->extract-msg==0.41.1->-r requirements.txt (line 9)) (1.16.0)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from pandas>=1.3->chromadb==0.3.23->-r requirements.txt (line 3)) (2.8.2)
Collecting monotonic>=1.5 (from posthog>=2.4.0->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached monotonic-1.6-py2.py3-none-any.whl (8.2 kB)
Collecting backoff>=1.10.0 (from posthog>=2.4.0->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached backoff-2.2.1-py3-none-any.whl (15 kB)
Requirement already satisfied: idna<4,>=2.5 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from requests<3,>=2->langchain==0.0.171->-r requirements.txt (line 1)) (3.4)
INFO: pip is looking at multiple versions of requests to determine which version is compatible with other requirements. This could take a while.
Collecting requests<3,>=2 (from langchain==0.0.171->-r requirements.txt (line 1))
Using cached requests-2.30.0-py3-none-any.whl (62 kB)
Collecting transformers<5.0.0,>=4.6.0 (from sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached transformers-4.29.2-py3-none-any.whl (7.1 MB)
Requirement already satisfied: tqdm in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3)) (4.65.0)
Collecting torch>=1.6.0 (from sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached torch-2.0.1-cp310-cp310-win_amd64.whl (172.3 MB)
Collecting torchvision (from sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt
(line 3))
Using cached torchvision-0.15.2-cp310-cp310-win_amd64.whl (1.2 MB)
Collecting scikit-learn (from sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached scikit_learn-1.2.2-cp310-cp310-win_amd64.whl (8.3 MB)
Collecting scipy (from sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line
3))
Using cached scipy-1.10.1-cp310-cp310-win_amd64.whl (42.5 MB)
Collecting sentencepiece (from sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached sentencepiece-0.1.99-cp310-cp310-win_amd64.whl (977 kB)
Collecting huggingface-hub>=0.4.0 (from sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached huggingface_hub-0.14.1-py3-none-any.whl (224 kB)
Collecting greenlet!=0.4.17 (from SQLAlchemy<3,>=1.4->langchain==0.0.171->-r requirements.txt (line 1))
Using cached greenlet-2.0.2-cp310-cp310-win_amd64.whl (192 kB)
Requirement already satisfied: click>=7.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from uvicorn[standard]>=0.18.3->chromadb==0.3.23->-r requirements.txt (line
3)) (8.1.3)
Requirement already satisfied: h11>=0.8 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from uvicorn[standard]>=0.18.3->chromadb==0.3.23->-r requirements.txt (line 3)) (0.14.0)
Requirement already satisfied: colorama>=0.4 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from uvicorn[standard]>=0.18.3->chromadb==0.3.23->-r requirements.txt (line 3)) (0.4.6)
Collecting httptools>=0.5.0 (from uvicorn[standard]>=0.18.3->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached httptools-0.5.0-cp310-cp310-win_amd64.whl (142 kB)
Collecting watchfiles>=0.13 (from uvicorn[standard]>=0.18.3->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached watchfiles-0.19.0-cp37-abi3-win_amd64.whl (270 kB)
Collecting websockets>=10.4 (from uvicorn[standard]>=0.18.3->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached websockets-11.0.3-cp310-cp310-win_amd64.whl (124 kB)
Collecting httpx<0.24,>=0.15 (from argilla->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached httpx-0.23.3-py3-none-any.whl (71 kB)
Collecting deprecated~=1.2.0 (from argilla->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached Deprecated-1.2.13-py2.py3-none-any.whl (9.6 kB)
Requirement already satisfied: packaging>=20.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from argilla->unstructured==0.6.6->-r requirements.txt (line 8)) (23.1)Collecting pandas>=1.3 (from chromadb==0.3.23->-r requirements.txt (line 3))
Using cached pandas-1.5.3-cp310-cp310-win_amd64.whl (10.4 MB)
Collecting wrapt<1.15,>=1.13 (from argilla->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached wrapt-1.14.1-cp310-cp310-win_amd64.whl (35 kB)
Collecting numpy<2,>=1 (from langchain==0.0.171->-r requirements.txt (line 1))
Using cached numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB)
Collecting rich<=13.0.1 (from argilla->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached rich-13.0.1-py3-none-any.whl (238 kB)
Collecting typer<1.0.0,>=0.6.0 (from argilla->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached typer-0.9.0-py3-none-any.whl (45 kB)
Requirement already satisfied: joblib in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from nltk->unstructured==0.6.6->-r requirements.txt (line 8)) (1.2.0)
Requirement already satisfied: regex>=2021.8.3 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from nltk->unstructured==0.6.6->-r requirements.txt (line 8)) (2023.3.23)
Requirement already satisfied: et-xmlfile in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from openpyxl->unstructured==0.6.6->-r requirements.txt (line 8)) (1.1.0)
Requirement already satisfied: pywin32 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from plumbum->pandoc==2.3->-r requirements.txt (line 11)) (306)
Collecting XlsxWriter>=0.5.7 (from python-pptx->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached XlsxWriter-3.1.0-py3-none-any.whl (152 kB)
Requirement already satisfied: pycparser in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from cffi>=1.12->cryptography>=36.0.0->pdfminer.six==20221105->-r requirements.txt (line 6)) (2.21)
Collecting httpcore<0.17.0,>=0.15.0 (from httpx<0.24,>=0.15->argilla->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached httpcore-0.16.3-py3-none-any.whl (69 kB)
Collecting rfc3986[idna2008]<2,>=1.3 (from httpx<0.24,>=0.15->argilla->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached rfc3986-1.5.0-py2.py3-none-any.whl (31 kB)
Requirement already satisfied: sniffio in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from httpx<0.24,>=0.15->argilla->unstructured==0.6.6->-r requirements.txt (line 8)) (1.3.0)
Requirement already satisfied: filelock in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from huggingface-hub>=0.4.0->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3)) (3.12.0)
Collecting fsspec (from huggingface-hub>=0.4.0->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached fsspec-2023.5.0-py3-none-any.whl (160 kB)
Collecting pyparsing<3,>=2.1.0 (from oletools>=0.56->RTFDE==0.0.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting easygui (from oletools>=0.56->RTFDE==0.0.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached easygui-0.98.3-py2.py3-none-any.whl (92 kB)
Collecting colorclass (from oletools>=0.56->RTFDE==0.0.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached colorclass-2.2.2-py2.py3-none-any.whl (18 kB)
Collecting pcodedmp>=1.2.5 (from oletools>=0.56->RTFDE==0.0.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached pcodedmp-1.2.6-py2.py3-none-any.whl (30 kB)
Collecting msoffcrypto-tool (from oletools>=0.56->RTFDE==0.0.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached msoffcrypto_tool-5.0.1-py3-none-any.whl (34 kB)
Collecting commonmark<0.10.0,>=0.9.0 (from rich<=13.0.1->argilla->unstructured==0.6.6->-r requirements.txt (line 8))
Using cached commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
Requirement already satisfied: pygments<3.0.0,>=2.6.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from rich<=13.0.1->argilla->unstructured==0.6.6->-r requirements.txt (line 8)) (2.15.1)
Requirement already satisfied: anyio<5,>=3.4.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from starlette<0.28.0,>=0.27.0->fastapi>=0.85.1->chromadb==0.3.23->-r requirements.txt (line 3)) (3.6.2)
Collecting sympy (from torch>=1.6.0->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached sympy-1.12-py3-none-any.whl (5.7 MB)
Collecting networkx (from torch>=1.6.0->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached networkx-3.1-py3-none-any.whl (2.1 MB)
Requirement already satisfied: jinja2 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from torch>=1.6.0->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3)) (3.1.2)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers<5.0.0,>=4.6.0->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached tokenizers-0.13.3-cp310-cp310-win_amd64.whl (3.5 MB)
Requirement already satisfied: mypy-extensions>=0.3.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.171->-r requirements.txt (line 1)) (1.0.0)
Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting win-unicode-console (from pcodedmp>=1.2.5->oletools>=0.56->RTFDE==0.0.2->extract-msg==0.41.1->-r requirements.txt (line 9))
Using cached win_unicode_console-0.5-py3-none-any.whl
Requirement already satisfied: MarkupSafe>=2.0 in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (from jinja2->torch>=1.6.0->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3)) (2.1.2)
Collecting mpmath>=0.19 (from sympy->torch>=1.6.0->sentence-transformers>=2.2.2->chromadb==0.3.23->-r requirements.txt (line 3))
Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)
Building wheels for collected packages: hnswlib
Building wheel for hnswlib (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for hnswlib (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [12 lines of output] running bdist_wheel running build running build_ext building 'hnswlib' extension creating build creating build\temp.win-amd64-cpython-310 creating build\temp.win-amd64-cpython-310\Release creating build\temp.win-amd64-cpython-310\Release\python_bindings "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Users\User\AppData\Local\Temp\pip-build-env-zu5ywh3d\overlay\Lib\site-packages\pybind11\include -IC:\Users\User\AppData\Local\Temp\pip-build-env-zu5ywh3d\overlay\Lib\site-packages\numpy\core\include -I./hnswlib/ -IC:\Users\User\AppData\Local\Programs\Python\Python310\include -IC:\Users\User\AppData\Local\Programs\Python\Python310\Include "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\ATLMFC\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Auxiliary\VS\include" /EHsc /Tp./python_bindings/bindings.cpp /Fobuild\temp.win-amd64-cpython-310\Release./python_bindings/bindings.obj /EHsc /openmp /O2 /DVERSION_INFO=\"0.7.0\" bindings.cpp C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\include\yvals.h(17): fatal error C1083: cannot open include file: 'crtdbg.h': No such file or directory error: command 'C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\bin\HostX86\x64\cl.exe' failed with exit code 2 [end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for hnswlib Failed to build hnswlib ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects
I have the same error
same here
I managed to fix it by installing full visual studio (community)
If you google for fatal error C1083: cannot open include file: 'crtdbg.h': No such file or directory or Failed building wheel for hnswlib Failed to build hnswlib ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects you find a lot of discussions and possible solutions.
I managed to fix it by installing full visual studio (community)
I did that too, but still have the same error message and I have already tried to use windows SDK to add into the path in evironment variables, but still failed.
I have already tried to use windows SDK to add into the path in evironment variables, but still failed.
I resolved this problem by using Visual Studio and installed "C++-CMake-Tools for Windows"
Same error, any hack for it ??
To Resolve this issue in Windows
You need to download https://visualstudio.microsoft.com/visual-cpp-build-tools/ first.
Next, navigate to "Individual components", find these two MCVS v143 VS2022 C++ x64/86 latest
and Windows 10 SDK Windows 11 SDK latest
Please close the issue if it is resolved.
I managed to fix it by installing full visual studio (community)
I tried full visual studio too but still faced the same error code in vs code and also vs 2022.
Please close the issue if it is resolved.
Not solved yet..
Dear guys,
I have already set the file path of windows kit, but it still failed, I do not know what are the problems underlying...
have you installed "C++-CMake-Tools for Windows"
have you installed "C++-CMake-Tools for Windows"
Yes, I already downloaded the CMake- Tools in Vs code
Please take a look, Thanks !!
Sorry, I'm also a newbie ,I used CMake- Tools to solve the problem, if not, I don't know what to do.
Sorry, I'm also a newbie ,I used CMake- Tools to solve the problem, if not, I don't know what to do.
That is alright, thanks for your suggestions anyway!
To Resolve this issue in Windows
You need to download https://visualstudio.microsoft.com/visual-cpp-build-tools/ first.
Next, navigate to "Individual components", find these two MCVS v143 VS2022 C++ x64/86 latest
and Windows 10 SDK Windows 11 SDK latest
In the link you provided there is no option saying individual components. Where should I go to find it? Is it possible to give some concrete steps?
You are not alone ;-)
Same with me. i installed SDK's, Extensions, Make Tools, complete VS Studio and everything named in this Thread.
`obj : error LNK2001: unresolved external symbol __imp__PyBytes_Size bindings.obj : error LNK2001: unresolved external symbol __imp__PyDict_New bindings.obj : error LNK2001: unresolved external symbol __imp__PyList_GetItem bindings.obj : error LNK2001: unresolved external symbol __imp__PyException_SetContext bindings.obj : error LNK2001: unresolved external symbol __imp__PyInstanceMethod_New bindings.obj : error LNK2001: unresolved external symbol __imp__PyObject_IsInstance bindings.obj : error LNK2001: unresolved external symbol __imp__PyUnicode_DecodeUTF32 bindings.obj : error LNK2001: unresolved external symbol __imp__PyMem_Free bindings.obj : error LNK2001: unresolved external symbol __imp__PyTuple_SetItem bindings.obj : error LNK2001: unresolved external symbol __imp__PyCMethod_New bindings.obj : error LNK2001: unresolved external symbol __imp__PyThread_tss_set bindings.obj : error LNK2001: unresolved external symbol __imp__PyObject_GetItem bindings.obj : error LNK2001: unresolved external symbol __imp__PyObject_CallObject bindings.obj : error LNK2001: unresolved external symbol __imp__PyObject_HasAttrString bindings.obj : error LNK2001: unresolved external symbol __imp__PyProperty_Type bindings.obj : error LNK2001: unresolved external symbol __imp__PyIndex_Check bindings.obj : error LNK2001: unresolved external symbol __imp___Py_NotImplementedStruct bindings.obj : error LNK2001: unresolved external symbol __imp__PyByteArray_Size bindings.obj : error LNK2001: unresolved external symbol __imp__PyGILState_Ensure bindings.obj : error LNK2001: unresolved external symbol __imp__PyCapsule_SetContext bindings.obj : error LNK2001: unresolved external symbol __imp__PyNumber_Check bindings.obj : error LNK2001: unresolved external symbol __imp__PyNumber_Long bindings.obj : error LNK2001: unresolved external symbol __imp__PyThread_tss_alloc bindings.obj : error LNK2001: unresolved external symbol __imp__PyThreadState_DeleteCurrent bindings.obj : error LNK2001: unresolved external symbol __imp__PyExc_TypeError bindings.obj : error LNK2001: unresolved external symbol __imp__PyThreadState_Clear bindings.obj : error LNK2001: unresolved external symbol __imp__PyCapsule_Type bindings.obj : error LNK2001: unresolved external symbol __imp__PyEval_GetBuiltins bindings.obj : error LNK2001: unresolved external symbol __imp__PyDict_Copy bindings.obj : error LNK2001: unresolved external symbol __imp__PyObject_Str bindings.obj : error LNK2001: unresolved external symbol __imp__PyUnicode_AsUTF8String bindings.obj : error LNK2001: unresolved external symbol __imp__PyModule_Type bindings.obj : error LNK2001: unresolved external symbol __imp__PyCallable_Check bindings.obj : error LNK2001: unresolved external symbol __imp__PyFrame_GetBack bindings.obj : error LNK2001: unresolved external symbol __imp__PyFrame_GetCode bindings.obj : error LNK2001: unresolved external symbol __imp__PyExc_IndexError bindings.obj : error LNK2001: unresolved external symbol __imp__PyExc_ImportError bindings.obj : error LNK2001: unresolved external symbol __imp__PyCapsule_SetPointer bindings.obj : error LNK2001: unresolved external symbol __imp___Py_TrueStruct bindings.obj : error LNK2001: unresolved external symbol __imp__PyExc_SystemError bindings.obj : error LNK2001: unresolved external symbol __imp__PyObject_SetItem bindings.obj : error LNK2001: unresolved external symbol __imp__PyException_SetCause bindings.obj : error LNK2001: unresolved external symbol __imp__PyDict_DelItemString bindings.obj : error LNK2001: unresolved external symbol __imp__PyUnicode_FromString bindings.obj : error LNK2001: unresolved external symbol __imp__PyLong_FromSize_t bindings.obj : error LNK2001: unresolved external symbol __imp__PyEval_AcquireThread bindings.obj : error LNK2001: unresolved external symbol __imp___PyType_Lookup bindings.obj : error LNK2001: unresolved external symbol __imp__PyGILState_GetThisThreadState bindings.obj : error LNK2001: unresolved external symbol __imp__PyBuffer_Release bindings.obj : error LNK2001: unresolved external symbol __imp__PyObject_Repr bindings.obj : error LNK2001: unresolved external symbol __imp__PyByteArray_Type bindings.obj : error LNK2001: unresolved external symbol __imp__PyNumber_Float bindings.obj : error LNK2001: unresolved external symbol __imp__PyType_Type bindings.obj : error LNK2001: unresolved external symbol __imp__PySequence_Tuple bindings.obj : error LNK2001: unresolved external symbol __imp__PyCapsule_SetName bindings.obj : error LNK2001: unresolved external symbol __imp__PyEval_RestoreThread bindings.obj : error LNK2001: unresolved external symbol __imp___PyObject_GetDictPtr build\lib.win32-cpython-311\hnswlib.cp311-win_amd64.pyd : fatal error LNK1120: 137 unresolved externals error: command 'C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.36.32532\bin\HostX86\x86\link.exe' failed with exit code 1120 [end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for hnswlib Building wheel for wrapt (pyproject.toml) ... done Created wheel for wrapt: filename=wrapt-1.14.1-cp311-cp311-win32.whl size=21663 sha256=6e7b715060b9b0ceea32fa8b900b65d62fa38c5a20ef0414c0c190d2e96e3bf7 Stored in directory: c:\users\peter\appdata\local\pip\cache\wheels\eb\b6\fa\5ab6f4107cad63fa04c54ad78d75bb7035119bdd4f751df5ae Successfully built llama-cpp-python wrapt Failed to build hnswlib ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects`
I'm also having the same issue. Has there been a solid solution. I've looked high and low, but the suggestions are all over the place.
Here's my output starting at the error: Creating library build\temp.win32-cpython-311\Release./python_bindings\hnswlib.cp311-win_amd64.lib and object build\temp.win32-cpython-311\Release./python_bindings\hnswlib.cp311-win_amd64.exp bindings.obj : error LNK2001: unresolved external symbol __imp__PyThread_tss_create ........ bindings.obj : error LNK2001: unresolved external symbol __imp___PyObject_GetDictPtr build\lib.win32-cpython-311\hnswlib.cp311-win_amd64.pyd : fatal error LNK1120: 137 unresolved externals error: command 'C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\bin\HostX86\x86\link.exe' failed with exit code 1120 [end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for hnswlib Successfully built llama-cpp-python Failed to build hnswlib ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects
I'm not sure if this will help, but further up in my output, I have this:
Using cached mpmath-1.3.0-py3-none-any.whl (536 kB) Building wheels for collected packages: llama-cpp-python, hnswlib Building wheel for llama-cpp-python (pyproject.toml) ... done Created wheel for llama-cpp-python: filename=llama_cpp_python-0.1.50-cp311-cp311-win32.whl size=249426 sha256=503e1f6da65d99b24159c3de11d999e7fe611b7f0e61c945a714f41f173e2588 Stored in directory: c:\users\bgentry\appdata\local\packages\pythonsoftwarefoundation.python.3.11_qbz5n2kfra8p0\localcache\local\pip\cache\wheels\b1\5d\b9\233531d6ca06624db502af0ca6523faa00b6d4d5cec8ab09eb Building wheel for hnswlib (pyproject.toml) ... error error: subprocess-exited-with-error
× Building wheel for hnswlib (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [233 lines of output] running bdist_wheel running build running build_ext building 'hnswlib' extension creating build creating build\temp.win32-cpython-311 creating build\temp.win32-cpython-311\Release creating build\temp.win32-cpython-311\Release\python_bindings
There's a great deal of information in the following links, but it's over my head.
https://learn.microsoft.com/en-us/cpp/error-messages/tool-errors/linker-tools-error-lnk2001?view=msvc-170
https://stackoverflow.com/questions/12573816/what-is-an-undefined-reference-unresolved-external-symbol-error-and-how-do-i-fix
To Resolve this issue in Windows
You need to download https://visualstudio.microsoft.com/visual-cpp-build-tools/ first.
Next, navigate to "Individual components", find these two MCVS v143 VS2022 C++ x64/86 latest
and Windows 10 SDK Windows 11 SDK latest
Thanks! This solution worked for me.
FYI, when you're installing Microsoft C++ Build Tools - Individual components, don't use the search, it doesn't work (at least for me), browse the list and select them.
I already had those installed, There seems to be a problem with the pyproject.toml file:
The output where the error begins: Building wheel for hnswlib (pyproject.toml) ... error error: subprocess-exited-with-error
× Building wheel for hnswlib (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [233 lines of output] running bdist_wheel running build running build_ext building 'hnswlib' extension creating build creating build\temp.win32-cpython-311 creating build\temp.win32-cpython-311\Release creating build\temp.win32-cpython-311\Release\python_bindings
Contents of the pyproject.toml: [build-system] requires = [ "setuptools>=42", "wheel", "numpy>=1.10.0", "pybind11>=2.0", ]
build-backend = "setuptools.build_meta"
Unless I'm reading the output wrong, which is possible, maybe even likely.
I have the same issue as @peterelli, where the linker cannot find the Python C API functions. Did you ever find a solution?
I verified that the .lib files exist in the LIBPATH. The link command seems to be a mismash of x86/win32 and amd64/win_amd64 directories. Any hints where those are generated?
To Resolve this issue in Windows You need to download https://visualstudio.microsoft.com/visual-cpp-build-tools/ first. Next, navigate to "Individual components", find these two MCVS v143 VS2022 C++ x64/86 latest and Windows 10 SDK Windows 11 SDK latest
In the link you provided there is no option saying individual components. Where should I go to find it? Is it possible to give some concrete steps?
Thanks for providing an exact solution to this problem. the whole day I have invested to solve this problem by installing a multiple c++ package but when I installed the individual component as you have mentioned , this will help to fix the error
@Abbodarr I think you might be into something. For X64 users I think this path is wrong: C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.36.32532\bin\HostX86\x86\link.exe. Maybe it should be: C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.36.32532\bin\Hostx64\x64 ?
I have the same issue as @peterelli, where the linker cannot find the Python C API functions. Did you ever find a solution?
I verified that the .lib files exist in the LIBPATH. The link command seems to be a mismash of x86/win32 and amd64/win_amd64 directories. Any hints where those are generated?
Hello, same issue here:
Windows 11, x64 arch (AMD Ryzen 7 5800X 8-Core Processor), python 3.11.3 And error while building hnswlib:
"C:\Program Files\Microsoft Visual Studio\2022\Professional\VC\Tools\MSVC\14.36.32532\bin\HostX86\x86\link.exe" /nologo /INCREMENTAL:NO /LTCG /DLL /MANIFEST:EMBED,ID=2 /MANIFESTUAC:NO "/LIBPATH:C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1008.0_x64__qbz5n2kfra8p0\libs" "/LIBPATH:C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1008.0_x64__qbz5n2kfra8p0" "/LIBPATH:C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1008.0_x64__qbz5n2kfra8p0\PCbuild\win32" "/LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Professional\VC\Tools\MSVC\14.36.32532\ATLMFC\lib\x86" "/LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Professional\VC\Tools\MSVC\14.36.32532\lib\x86" "/LIBPATH:C:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\lib\um\x86" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.22621.0\ucrt\x86" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.22621.0\um\x86" "/LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Professional\VC\Tools\MSVC\14.36.32532\ATLMFC\lib\x86" "/LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Professional\VC\Tools\MSVC\14.36.32532\lib\x86" "/LIBPATH:C:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\lib\um\x86" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.22621.0\ucrt\x86" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.22621.0\um\x86" /EXPORT:PyInit_hnswlib build\temp.win32-cpython-311\Release./python_bindings/bindings.obj /OUT:build\lib.win32-cpython-311\hnswlib.cp311-win_amd64.pyd /IMPLIB:build\temp.win32-cpython-311\Release./python_bindings\hnswlib.cp311-win_amd64.lib Creating library build\temp.win32-cpython-311\Release./python_bindings\hnswlib.cp311-win_amd64.lib and object build\temp.win32-cpython-311\Release./python_bindings\hnswlib.cp311-win_amd64.exp bindings.obj : error LNK2001: unresolved external symbol __imp__PyThread_tss_create bindings.obj : error LNK2001: unresolved external symbol __imp__PyUnicode_AsEncodedString ...
@martmyth : good idea, how can I change HostX86\x86\link.exe to Hostx64\x64 ? or the target platform generally ? @Abbodarr, @peterelli : any progress on your side ?
Al
@aalev I'm not sure I think this has to do with it: /LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Professional\VC\Tools\MSVC\14.36.32532\ATLMFC\lib\x86 but not sure how to change it
I am getting a similar issue. Any solutions for a Linux machine?