Rasoul Nikbakht

Results 1 comments of Rasoul Nikbakht

I cannot run Phi-3 with the `vllm/vllm-openai:v0.4.2` image. I am using this command: ```bash docker run -it --runtime nvidia --gpus all \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HUGGING_FACE_HUB_TOKEN=" \ -p 8081:8000...