sd-forge-couple
sd-forge-couple copied to clipboard
[FEATURE REQUEST] TWO-SHOT Drawing masks (from Latent couple)
I was wondering if you could add an option to also use color coded masks (like in the old Stable-diffusion two shot), where each color is a specific area that you prompt.
The thing is, the current Latent couple extension does not work with forge. SO I was wondering if you could also add it to Forge couple? The reason i am asking is because with the tiles, you are limited to what goes wear, while with the color masking, you can have seperated areas as a mask (lets say some complex fight scene where the head and arm is visible but the torso is not, and then another guy is blocking that view, so you'd have to somehow mask it so that prompt belong to the same one.
Basically a color coded masks that can be "seperate" but would still follow the prompt.
Not sure if I follow
Doesn't the Advanced
mapping already do this?
Not sure if I follow
Doesn't the
Advanced
mapping already do this?
You are right, the tile does work to some extent, . But I meant like a "masking" option, where you can draw over specific areas, so for example 2 seperate "regions" for the same line/prompt. (to be able to make Overlaps, etc.
Not sure if I follow
Doesn't the
Advanced
mapping already do this?
they mean a mask you can draw, for even more control
any plans for being able to draw a mask?
After I finish revamping Advanced
mode to support the new Forge I guess
Still need a good way to store multiple "layers" of images after you draw the mask though...
Aight, time to think of a way to implement Mask
mode to the UI...
Awesome, can't wait for the update! Does Forge Couple work on new Forge now? I wasn't sure if I need to reinstall it from here or wait for the integrated version inside of Forge to be updated.
I'm SUPER excited for masking mode as this was pretty much the only feature Regional Prompter had that Forge Couple did not.
Thank you so much for all your work!
Does Forge Couple work on new Forge now?
Yes. It should work for the new Forge now. (Only SD 1.5
and SDXL
, but not Flux
)
~~Slowly going insane from working with Gradio 3 Image
component...~~
Hello, please give the mask branch a try~
Only works for old Forge (
Gradio 3
) right now...
playing around with it at the moment, needs a way to clear the actual canvas. when i "Save mask" it doesn't clear the canvas, so it ends up duplicating everything and i don't see where to clear it.
using it on reForge with gradio 3.41.2
Oh, click the Create Empty Canvas
button to clear the canvas.
Oh, click the
Create Empty Canvas
button to clear the canvas.
doesn't work, when i click it the anvas stasy the same. is probably because of reForge though.
doesn't work, when i click it the anvas stasy the same. is probably because of reForge though
Wait, really? Let me try.
i'll assume that any errors are because of the (somewhat?) old version of reForge i'm using. I'll see if anything changes if I update it though I don't remember if they started using gradio 4 in the newer reForge.
Huh, it's working for me on reForge though. Using the main
branch.
Let me try dev_upstream
branch real quick.
apparently this is the version i'm on: https://github.com/Panchovix/stable-diffusion-webui-reForge/commit/a75e69cb3528726e11a41f23fdec745a9f03d795
I'll update and re-check everything again. it was likely just because of that version of reforge
Clicking the Create Empty Canvas
button empties the canvas for me, on the latest commit of both main
and dev_upstream
branch of reForge.
Just updated and it does indeed clear now! Thank you for cour continued work and support on this add-on! 🥳
There was code added code to OG forge for Latent couple
It is a bit late but "online loras" are currently available now: https://github.com/lllyasviel/stable-diffusion-webui-forge/blob/2f1d04759f36122cbb3553f0f0758755790624c7/backend/operations.py#L14 - lllyasviel
View “online lora” as a module similar to ControlLoRA so that it is moved to GPU together with model when sampling, achieving significant speedup and perfect low VRAM management simultaneously. - lllyasviel
the code hasn't been ported over to reforge yet, and i'm not sure if it just help with Latent couple or 100% fixes Latent couple.