text-generation-webui
text-generation-webui copied to clipboard
Docker Install - Launching the image - Potential command update required
Describe the bug
I checked #5679 but it doesn't seem related to this since it's about the cpu build.
I believe the line in "Use these commands to launch the image" at https://github.com/oobabooga/text-generation-webui/wiki/09-%E2%80%90-Docker should be changed as per the below.
From:
ln -s docker/{nvidia/Dockerfile,docker-compose.yml,.dockerignore} .
To:
ln -s docker/{nvidia/Dockerfile,nvidia/docker-compose.yml,.dockerignore} .
The other two files are correctly linked but, unti l ran the latter command, the docker-compose.yml
link was pointing at a nonexistent file.
Apologies if I've missed something, this is my first issue.
Is there an existing issue for this?
- [X] I have searched the existing issues
Reproduction
Run commands:
cd text-generation-webui
ln -s docker/{nvidia/Dockerfile,docker-compose.yml,.dockerignore} .
cp docker/.env.example .env
# Edit .env and set TORCH_CUDA_ARCH_LIST based on your GPU model
docker compose up --build
There will be an error since docker-compose.yml
is found at nvidia/docker-compose.yml
. Changing it to this should work:
cd text-generation-webui
ln -s docker/{nvidia/Dockerfile,nvidia/docker-compose.yml,.dockerignore} .
cp docker/.env.example .env
# Edit .env and set TORCH_CUDA_ARCH_LIST based on your GPU model
docker compose up --build
Screenshot
No response
Logs
N/A
System Info
N/A
Thank you. Initially, following the instructions provided in the repo wasn't working for me and I almost gave up until I saw this and it worked.
Thanks for saying so, I wasn't sure if I'd missed something else myself. Glad to hear it worked for someone else!