openvino_notebooks icon indicating copy to clipboard operation
openvino_notebooks copied to clipboard
verified publisher icon openvinotoolkit

notebook "llm rag llama-index" fail to initial

Open JamieVC opened this issue 1 year ago • 4 comments

To compare multiple LLM models to OEM/ODM, we are running this sample.

  1. install new env based on openvino guide: https://github.com/openvinotoolkit/openvino_notebooks/wiki/Windows
  2. run >jupyter lab notebooks\llm-rag-llamaindex\llm-rag-llamaindex.ipynb
  3. run the first section in https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/llm-rag-llamaindex/llm-rag-llamaindex.ipynb

-error log-

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gradio 5.8.0 requires huggingface-hub>=0.25.1, but you have huggingface-hub 0.23.5 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-embeddings-huggingface<0.5.0,>=0.4.0, but you have llama-index-embeddings-huggingface 0.3.1 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-llms-huggingface<0.5.0,>=0.4.0, but you have llama-index-llms-huggingface 0.3.3 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
llama-index-embeddings-openvino 0.5.0 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-embeddings-huggingface<0.5.0,>=0.4.0, but you have llama-index-embeddings-huggingface 0.3.1 which is incompatible.
llama-index-llms-huggingface 0.3.3 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-llms-huggingface<0.5.0,>=0.4.0, but you have llama-index-llms-huggingface 0.3.3 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
Looking in indexes: https://pypi.org/simple, https://storage.openvinotoolkit.org/simple/wheels/nightly
Requirement already satisfied: openvino>=2024.2 in c:\windows\system32\openvino_env\lib\site-packages (2025.0.0.dev20241209)
Requirement already satisfied: numpy<2.2.0,>=1.16.6 in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (1.26.4)
Requirement already satisfied: openvino-telemetry>=2023.2.1 in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (2024.5.0)
Requirement already satisfied: packaging in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (24.2)
Looking in indexes: https://pypi.org/simple, https://storage.openvinotoolkit.org/simple/wheels/nightly
Requirement already satisfied: openvino-tokenizers>=2024.2 in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers[transformers]>=2024.2) (2025.0.0.0.dev20241209)
Requirement already satisfied: openvino~=2025.0.0.dev in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (2025.0.0.dev20241209)
Requirement already satisfied: transformers>=4.36.0 in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.46.3)
Requirement already satisfied: tiktoken in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers[transformers]>=2024.2) (0.8.0)
Requirement already satisfied: numpy<2.2.0,>=1.16.6 in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (1.26.4)
Requirement already satisfied: openvino-telemetry>=2023.2.1 in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (2024.5.0)
Requirement already satisfied: packaging in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (24.2)
Requirement already satisfied: filelock in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.16.1)
Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.26.5)
Requirement already satisfied: pyyaml>=5.1 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (6.0.2)
Requirement already satisfied: regex!=2019.12.17 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.11.6)
Requirement already satisfied: requests in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2.32.3)
Requirement already satisfied: tokenizers<0.21,>=0.20 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.20.3)
Requirement already satisfied: safetensors>=0.4.1 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.4.5)
Requirement already satisfied: tqdm>=4.27 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.67.1)
Requirement already satisfied: sentencepiece!=0.1.92,>=0.1.91 in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.2.0)
Requirement already satisfied: protobuf in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (5.29.1)
Requirement already satisfied: fsspec>=2023.5.0 in c:\windows\system32\openvino_env\lib\site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.9.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\windows\system32\openvino_env\lib\site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.12.2)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2.2.3)
Requirement already satisfied: certifi>=2017.4.17 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.8.30)
Requirement already satisfied: colorama in c:\windows\system32\openvino_env\lib\site-packages (from tqdm>=4.27->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.4.6)

JamieVC avatar Dec 10 '24 10:12 JamieVC

Can you try to create a new (not used before) Python virtual environment, activate it and run the notebook again from within the activated Python virtual environment? Which OS, which version of Python do you use?

brmarkus avatar Dec 10 '24 10:12 brmarkus

Can you try to create a new (not used before) Python virtual environment, activate it and run the notebook again from within the activated Python virtual environment? Which OS, which version of Python do you use?

Hi OS version is 24H2 26100.2314 and python version is 3.10.11 We've tried to delete openvino_env and openvino_notebooks folder under C:\Windows\System32 and re-download with step then still pop out same failure.

Wilson120603 avatar Dec 11 '24 01:12 Wilson120603

pip list Package Version

about-time 4.2.1 accelerate 1.2.1 aiofiles 23.2.1 aiohappyeyeballs 2.4.4 aiohttp 3.11.10 aiosignal 1.3.2 alive-progress 3.2.0 annotated-types 0.7.0 anyio 4.7.0 argon2-cffi 23.1.0 argon2-cffi-bindings 21.2.0 arrow 1.3.0 asttokens 3.0.0 async-lru 2.0.4 async-timeout 4.0.3 attrs 24.3.0 autograd 1.7.0 babel 2.16.0 beautifulsoup4 4.12.3 bleach 6.2.0 certifi 2024.12.14 cffi 1.17.1 charset-normalizer 3.4.0 click 8.1.7 cma 3.2.2 colorama 0.4.6 coloredlogs 15.0.1 comm 0.2.2 contourpy 1.3.1 cycler 0.12.1 dataclasses-json 0.6.7 datasets 3.2.0 debugpy 1.8.11 decorator 5.1.1 defusedxml 0.7.1 Deprecated 1.2.15 dill 0.3.8 dirtyjson 1.0.8 distro 1.9.0 exceptiongroup 1.2.2 executing 2.1.0 faiss-cpu 1.9.0.post1 fastapi 0.115.6 fastjsonschema 2.21.1 ffmpy 0.4.0 filelock 3.16.1 filetype 1.2.0 fonttools 4.55.3 fqdn 1.5.1 frozenlist 1.5.0 fsspec 2024.9.0 gradio 5.9.1 gradio_client 1.5.2 grapheme 0.6.0 greenlet 3.1.1 h11 0.14.0 httpcore 1.0.7 httpx 0.28.1 huggingface-hub 0.27.0 humanfriendly 10.0 idna 3.10 ipykernel 6.29.5 ipython 8.30.0 ipywidgets 8.1.5 isoduration 20.11.0 jedi 0.19.2 Jinja2 3.1.4 jiter 0.8.2 joblib 1.4.2 json5 0.10.0 jsonpatch 1.33 jsonpointer 3.0.0 jsonschema 4.23.0 jsonschema-specifications 2024.10.1 jstyleson 0.0.2 jupyter_client 8.6.3 jupyter_core 5.7.2 jupyter-events 0.10.0 jupyter-lsp 2.2.5 jupyter_server 2.14.2 jupyter_server_terminals 0.5.3 jupyterlab 4.3.3 jupyterlab_pygments 0.3.0 jupyterlab_server 2.27.3 jupyterlab_widgets 3.0.13 kiwisolver 1.4.7 langchain 0.3.12 langchain-core 0.3.25 langchain-text-splitters 0.3.3 langsmith 0.2.3 llama-cloud 0.1.6 llama-index 0.11.23 llama-index-agent-openai 0.3.4 llama-index-cli 0.3.1 llama-index-core 0.11.23 llama-index-embeddings-huggingface 0.3.1 llama-index-embeddings-openai 0.2.5 llama-index-embeddings-openvino 0.5.0 llama-index-indices-managed-llama-cloud 0.6.0 llama-index-legacy 0.9.48.post4 llama-index-llms-huggingface 0.3.3 llama-index-llms-langchain 0.4.2 llama-index-llms-openai 0.2.16 llama-index-llms-openvino 0.4.0 llama-index-multi-modal-llms-openai 0.2.3 llama-index-postprocessor-openvino-rerank 0.4.0 llama-index-program-openai 0.2.0 llama-index-question-gen-openai 0.2.0 llama-index-readers-file 0.3.0 llama-index-readers-llama-parse 0.3.0 llama-index-vector-stores-faiss 0.2.1 llama-parse 0.5.17 markdown-it-py 3.0.0 MarkupSafe 2.1.5 marshmallow 3.23.1 matplotlib 3.10.0 matplotlib-inline 0.1.7 mdurl 0.1.2 minijinja 2.5.0 mistune 3.0.2 mpmath 1.3.0 multidict 6.1.0 multiprocess 0.70.16 mypy-extensions 1.0.0 natsort 8.4.0 nbclient 0.10.1 nbconvert 7.16.4 nbformat 5.10.4 nest-asyncio 1.6.0 networkx 3.3 ninja 1.11.1.3 nltk 3.9.1 nncf 2.15.0.dev0+c4799898 notebook_shim 0.2.4 numpy 1.26.4 onnx 1.17.0 openai 1.57.4 openvino 2025.0.0.dev20241216 openvino-telemetry 2024.5.0 openvino-tokenizers 2025.0.0.0.dev20241216 optimum 1.23.3 optimum-intel 1.22.0.dev0+9c4bccc orjson 3.10.12 overrides 7.7.0 packaging 24.2 pandas 2.2.3 pandocfilters 1.5.1 parso 0.8.4 pillow 11.0.0 pip 24.3.1 platformdirs 4.3.6 prometheus_client 0.21.1 prompt_toolkit 3.0.48 propcache 0.2.1 protobuf 5.29.1 psutil 6.1.0 pure_eval 0.2.3 pyarrow 18.1.0 pycparser 2.22 pydantic 2.10.3 pydantic_core 2.27.1 pydot 2.0.0 pydub 0.25.1 Pygments 2.18.0 pymoo 0.6.1.3 PyMuPDF 1.25.1 pyparsing 3.2.0 pypdf 5.1.0 pyreadline3 3.5.4 python-dateutil 2.9.0.post0 python-json-logger 3.2.1 python-multipart 0.0.20 pytz 2024.2 pywin32 308 pywinpty 2.0.14 PyYAML 6.0.2 pyzmq 26.2.0 referencing 0.35.1 regex 2024.11.6 requests 2.32.3 requests-toolbelt 1.0.0 rfc3339-validator 0.1.4 rfc3986-validator 0.1.1 rich 13.9.4 rpds-py 0.22.3 ruff 0.8.3 safehttpx 0.1.6 safetensors 0.4.5 scikit-learn 1.6.0 scipy 1.14.1 semantic-version 2.10.0 Send2Trash 1.8.3 sentence-transformers 3.3.1 sentencepiece 0.2.0 setuptools 75.6.0 shellingham 1.5.4 six 1.17.0 sniffio 1.3.1 soupsieve 2.6 SQLAlchemy 2.0.36 stack-data 0.6.3 starlette 0.41.3 striprtf 0.0.26 sympy 1.13.1 tabulate 0.9.0 tenacity 8.5.0 terminado 0.18.1 text-generation 0.7.0 threadpoolctl 3.5.0 tiktoken 0.8.0 tinycss2 1.4.0 tokenizers 0.20.3 tomli 2.2.1 tomlkit 0.13.2 torch 2.5.1+cpu tornado 6.4.2 tqdm 4.67.1 traitlets 5.14.3 transformers 4.46.3 typer 0.15.1 types-python-dateutil 2.9.0.20241206 typing_extensions 4.12.2 typing-inspect 0.9.0 tzdata 2024.2 uri-template 1.3.0 urllib3 2.2.3 uvicorn 0.34.0 wcwidth 0.2.13 webcolors 24.11.1 webencodings 0.5.1 websocket-client 1.8.0 websockets 14.1 wheel 0.45.1 widgetsnbextension 4.0.13 wrapt 1.17.0 xxhash 3.5.0 yarl 1.18.3

Wilson120603 avatar Dec 17 '24 02:12 Wilson120603

This issue will be closed in a week because of 9 months of no activity.

github-actions[bot] avatar Sep 27 '25 00:09 github-actions[bot]