StoryDiffusion icon indicating copy to clipboard operation
StoryDiffusion copied to clipboard

Ref img for background

Open mischaschaub opened this issue 1 year ago • 2 comments

Would it be possible to have a ref img for the background? This certainly would enhance continuity for a scene. At the moment I create a lot of stills and arrange these as keyframes in the great app dough from Banodoco. Works pretty.

mischaschaub avatar May 11 '24 15:05 mischaschaub

At present, I don't have a good idea to implement this operation, but can it be achieved by cutting out the image?

Z-YuPeng avatar May 15 '24 12:05 Z-YuPeng

@Z-YuPeng can we build some relationship between the background to the noised img, for example, during the denoising process, a model can identify the background tokens?

parryppp avatar May 16 '24 12:05 parryppp