runpod-worker-comfy icon indicating copy to clipboard operation
runpod-worker-comfy copied to clipboard

RunPod's Dockerless CLI

Open VicThor-wpp opened this issue 1 year ago • 7 comments

Hi, is there a way to implement the dockerless feature to speed up the building image process of the dockerfile?

A blog with info. https://blog.runpod.io/runpod-dockerless-cli-innovation/

VicThor-wpp avatar Feb 26 '24 15:02 VicThor-wpp

@VicThor-wpp that is something we have to look into, thanks for pointing it out!

TimPietrusky avatar Mar 05 '24 08:03 TimPietrusky

Im actually testing with Mkdir and CP in the dockerfile to move the files from /runpod_volumes and is working. It need the detailed list of particular models for each custom_node, but in the end speed up the first run and some custom nodes dont download the models, so it avoid the crash.

VicThor-wpp avatar Mar 05 '24 13:03 VicThor-wpp

@VicThor-wpp anything you wanna share? I am probably doing the same right now hehe

brgrp avatar Mar 13 '24 09:03 brgrp

any updates @brgrp @VicThor-wpp ?

voytek98 avatar Apr 18 '24 11:04 voytek98

@VicThor-wpp @brgrp @voytek98 did anyone of you came to any result?

TimPietrusky avatar May 28 '24 14:05 TimPietrusky

Yes, I make a web app for a interactive campaign for a week, I run on 3/10 runpod gpus and generate more than 20K images. Sorry I'm pretty busy right now but I'll try to make the time to make a guide.

Basically use the runpod storage to save huge models (checkpoint, ipadapters, loras, ctrlNet) and custom-modules and after with docker file install all dependencies of modules in a single pip install (tricky part) and copy all custom files (you cant change the location of all custom modules in the Comfy paths) but for a simpler workflow it should be more easy.

VicThor-wpp avatar May 28 '24 14:05 VicThor-wpp

@VicThor-wpp that sounds great! If you ever have time, we can also jump into a video call, and you can walk me through it, and I can convert this into a guide.

TimPietrusky avatar May 29 '24 11:05 TimPietrusky