AI-Horde icon indicating copy to clipboard operation
AI-Horde copied to clipboard

Docker container?

Open helloeverything1 opened this issue 2 years ago • 5 comments

Could a docker container be made to make it easier to contribute your processing power? Everything I run is containerized and so I tend to avoid things that aren't.

helloeverything1 avatar Sep 23 '22 02:09 helloeverything1

I could, if someone makes one :D

db0 avatar Sep 23 '22 08:09 db0

@helloeverything1 in the steps for setting up the worker you have to download a 4GB model. what approach would be better for you, having this model included in a docker container, having the container download the model from a slow mirror during the first run, or downloading the model yourself from https://huggingface.co/CompVis/stable-diffusion-v-1-4-original and providing it to the docker image?

manioo8 avatar Oct 04 '22 07:10 manioo8

I sorta just saw a cool open source project and wanted to help, not sure if I am the best one to make this decision. But I feel like having the container download the model on its first run is probably best for me because its self contained but the image doesn't have to be huge. (IDK if it matters at all for AI but with a mirror files could be updated on its side and the container could update itself)

helloeverything1 avatar Oct 05 '22 23:10 helloeverything1

My /2c is that it would kind of depend on the use case of the Dockerfile. I think having a more lightweight one that doesn't include the model directly in it's layers would make a lot of sense for some use cases, but I could see how having the model included and cached within the Docker container's layers could make sense in other use cases.

0xdevalias avatar Nov 06 '22 01:11 0xdevalias

docker image probably shouldn't include models, since there are over 100 of them now. But the worker needs a configuration to automatically download configured models without prompting the user.

wolfgangmeyers avatar Mar 02 '23 16:03 wolfgangmeyers

This issue dates back to a different era of the horde. Closing as stale, though reGen does have a container now. If there's a more update and specific request, open a new issue.

tazlin avatar Aug 26 '24 18:08 tazlin