inference
inference copied to clipboard
[Llama3] Docker dependencies issues
The following issues appear when running the LLM reference implementation
Dependencies in the docker container:
Collecting mistral-common>=1.4.4 (from mistral-common[opencv]>=1.4.4->vllm==0.6.3->-r requirements.txt (line 8))
Downloading mistral_common-1.5.0-py3-none-any.whl.metadata (4.6 kB)
Downloading mistral_common-1.4.4-py3-none-any.whl.metadata (4.6 kB)
ERROR: Cannot install -r requirements.txt (line 8), mistral-common and sentencepiece==0.1.99 because these package versions have conflicting dependencies.
The conflict is caused by:
The user requested sentencepiece==0.1.99
vllm 0.6.3 depends on sentencepiece
mistral-common 1.5.1 depends on sentencepiece==0.2.0
The user requested sentencepiece==0.1.99
vllm 0.6.3 depends on sentencepiece
mistral-common 1.5.0 depends on sentencepiece==0.2.0
The user requested sentencepiece==0.1.99
vllm 0.6.3 depends on sentencepiece
mistral-common 1.4.4 depends on sentencepiece==0.2.0
To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip to attempt to solve the dependency conflict
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts