ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

Seeking Advice on Persistent Model Loading in ComfyUI

Open mzhangzhicheng opened this issue 1 year ago • 4 comments

I'm currently facing challenges with the repeated loading times of models in ComfyUI. Each time I need to use a model, it requires a complete reload, which is quite time-consuming.

Is there a way to configure ComfyUI to maintain the models in a loaded state, perhaps through certain parameters or settings? This would greatly enhance efficiency and usability.

Any guidance or tips on this would be highly appreciated.

Thank you!

mzhangzhicheng avatar Jan 09 '24 11:01 mzhangzhicheng

Hey! Did you find a solution?

tiago-falves avatar Mar 21 '24 02:03 tiago-falves

No, I just reloaded models.

mzhangzhicheng avatar Mar 21 '24 03:03 mzhangzhicheng

I have the same problem here, using SDXL turbo and the ComfyUI API. The most time consuming part is model reloads at every request, even if the prompt json uses the same model everytime:

Requested to load AutoencoderKL Loading 1 new model Prompt executed in 3.54 seconds Requested to load SDXL Loading 1 new model

Any solutions / workarounds?

ZodiacFRA avatar Apr 19 '24 20:04 ZodiacFRA