DiffBIR icon indicating copy to clipboard operation
DiffBIR copied to clipboard

Will it improve performance if I apply other stable diffusion model which is finetuned on certain content images?

Open eeyrw opened this issue 2 years ago • 2 comments

As title said.

eeyrw avatar Oct 12 '23 16:10 eeyrw

I think Stable Diffusion v2 may not be suitable for some special domains, such as medical image. The reason is that stable diffusion is not able to generate those domain-specific images. So if you use other diffusion models finetuned on certain content images, I guess🤔 the performance will be improved.

0x3f3f3f3fun avatar Oct 13 '23 06:10 0x3f3f3f3fun

Yes. The certain content images refer general images with specific content such as human face rather than domain specific images. Is replacing weight of UNet by existing model and not finetuning LAControNet (plug-and-play) OKay?

eeyrw avatar Oct 13 '23 13:10 eeyrw