diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Integrate HiDiffusion

Open ShenZhang-Shin opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe. Object duplication and low efficiency happens when generating high-resolution image (2048x2048, 4096x4096) for stable diffusion models. HiDiffusion can solve these problems, increasing the resolution and speed of pretrained diffusion models. paper link; project link; code link

text-to-image: 2048x2048 resolution images generated by HiDiffusion image

HiDiffusion also supports controlnet and other tasks. controlnet: 2048x2048 resolution images image

Efficiency comparison with other acceleration methods, HiDiffusion can significantly reduce time consumption without compromising image quality. image

Describe the solution you'd like. HiDiffusion code is based diffusers and is designed as a plug-and-play implementation. It can be integrated into diffusers pipelines by only adding a single line of code! Users just needs to install hidiffusion

pip3 install hidiffusion

and use it by adding a single line of code

apply_hidiffusion(pipeline)

We want to integrate HiDiffusion into the official code and documentation so that more people can access this feature.

Describe alternatives you've considered. None

Additional context. None

ShenZhang-Shin avatar Jul 03 '24 10:07 ShenZhang-Shin