ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

Is it possible to use different lora models in different regions?

Open KimigaiiWuyi opened this issue 1 year ago • 8 comments

I don't know if this is even possible... I noticed that in the last Ksampler node, the same model is always connected to that node. In the last step, it seems to be contaminated by the Lora model for the whole area composition?

KimigaiiWuyi avatar Apr 03 '23 10:04 KimigaiiWuyi

I have the exactly same question

Season02 avatar Apr 04 '23 00:04 Season02

I have the exactly same question +1

pxjhll avatar Apr 04 '23 09:04 pxjhll

Same question. Just started messing around with regions in 1111 and using Composable Lora plugin you can use different LoRA per region.

Would like to know if that is possible with ComyUI, too. A small example would be awesome.

ShyRed avatar Apr 08 '23 17:04 ShyRed

I tried multi laten composition with different lora, but had no luck. Could anyone answer this question? Thank you!

daizhuo avatar May 01 '23 15:05 daizhuo

You kinda "can", not like the extension in auto1111 tho, but by pure cope and hope using the nodes. TLDR you connect the model with all the loras to the KSampler but with like 0.5 strength on each lora and each region prompt has connected the model clip and their own lora clip as well.

You are not limiting the lora influence, just letting them interfere enough to have their intended effects and then on the high res pass you kinda can fix the artifacts and weirdness.

MaxLanc avatar Jun 02 '23 20:06 MaxLanc

You kinda "can", not like the extension in auto1111 tho, but by pure cope and hope using the nodes. TLDR you connect the model with all the loras to the KSampler but with like 0.5 strength on each lora and each region prompt has connected the model clip and their own lora clip as well.

You are not limiting the lora influence, just letting them interfere enough to have their intended effects and then on the high res pass you kinda can fix the artifacts and weirdness.

Great 👍 Thank you so much! Could you attach one simple sample how to do that? That would be awesome!

daizhuo avatar Jun 03 '23 03:06 daizhuo

Sure thing, fair warning the results won't be as crisp and clear as they should but so far this is the only way without actually messing with the code lol

This is one such result ComfyUI_00064_

And this is the copium machine I noded in comfyUI, is pretty normal but it took me some seethe mald and cope to achieve lol imagen imagen imagen

MaxLanc avatar Jun 03 '23 19:06 MaxLanc

Great 👍 Thank you so much! Could you attach one simple sample how to do that? That would be awesome!

Forgot the quote, check answer up lol

MaxLanc avatar Jun 03 '23 20:06 MaxLanc