text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

Docker Install - Launching the image - Potential command update required

Open JonathanTurunen opened this issue 9 months ago • 2 comments

Describe the bug

I checked #5679 but it doesn't seem related to this since it's about the cpu build.

I believe the line in "Use these commands to launch the image" at https://github.com/oobabooga/text-generation-webui/wiki/09-%E2%80%90-Docker should be changed as per the below.

From:

ln -s docker/{nvidia/Dockerfile,docker-compose.yml,.dockerignore} .

To:

ln -s docker/{nvidia/Dockerfile,nvidia/docker-compose.yml,.dockerignore} .

The other two files are correctly linked but, unti l ran the latter command, the docker-compose.yml link was pointing at a nonexistent file.

Apologies if I've missed something, this is my first issue.

Is there an existing issue for this?

  • [X] I have searched the existing issues

Reproduction

Run commands:

cd text-generation-webui
ln -s docker/{nvidia/Dockerfile,docker-compose.yml,.dockerignore} .
cp docker/.env.example .env
# Edit .env and set TORCH_CUDA_ARCH_LIST based on your GPU model
docker compose up --build

There will be an error since docker-compose.yml is found at nvidia/docker-compose.yml. Changing it to this should work:

cd text-generation-webui
ln -s docker/{nvidia/Dockerfile,nvidia/docker-compose.yml,.dockerignore} .
cp docker/.env.example .env
# Edit .env and set TORCH_CUDA_ARCH_LIST based on your GPU model
docker compose up --build

Screenshot

No response

Logs

N/A

System Info

N/A

JonathanTurunen avatar May 07 '24 06:05 JonathanTurunen

Thank you. Initially, following the instructions provided in the repo wasn't working for me and I almost gave up until I saw this and it worked.

romonwafa avatar Jun 09 '24 02:06 romonwafa

Thanks for saying so, I wasn't sure if I'd missed something else myself. Glad to hear it worked for someone else!

JonathanTurunen avatar Jun 10 '24 03:06 JonathanTurunen