inference icon indicating copy to clipboard operation
inference copied to clipboard

[Llama3] Docker dependencies issues

Open pgmpablo157321 opened this issue 10 months ago • 0 comments

The following issues appear when running the LLM reference implementation

Dependencies in the docker container:

Collecting mistral-common>=1.4.4 (from mistral-common[opencv]>=1.4.4->vllm==0.6.3->-r requirements.txt (line 8))
  Downloading mistral_common-1.5.0-py3-none-any.whl.metadata (4.6 kB)
  Downloading mistral_common-1.4.4-py3-none-any.whl.metadata (4.6 kB)
ERROR: Cannot install -r requirements.txt (line 8), mistral-common and sentencepiece==0.1.99 because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested sentencepiece==0.1.99
    vllm 0.6.3 depends on sentencepiece
    mistral-common 1.5.1 depends on sentencepiece==0.2.0
    The user requested sentencepiece==0.1.99
    vllm 0.6.3 depends on sentencepiece
    mistral-common 1.5.0 depends on sentencepiece==0.2.0
    The user requested sentencepiece==0.1.99
    vllm 0.6.3 depends on sentencepiece
    mistral-common 1.4.4 depends on sentencepiece==0.2.0

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip to attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

pgmpablo157321 avatar Dec 03 '24 22:12 pgmpablo157321