enable free u

[jyoung105]

Thanks for awesome work. I want to adopt freeu(https://github.com/ChenyangSi/FreeU) to your library. Is there any plan to adopt it?

[strint]

I want to adopt freeu(https://github.com/ChenyangSi/FreeU) to your library. Is there any plan to adopt it?

Happy to see this idea! I will look into this and reply to you later @jyoung105

[jyoung105]

There is a code for freeu to unet2d and unet3d in diffusers. Check this repo please. https://github.com/search?q=repo%3Ahuggingface%2Fdiffusers%20freeu&type=code Thank you for reply!

[doombeaker]

There is a code for freeu to unet2d and unet3d in diffusers. Check this repo please. https://github.com/search?q=repo%3Ahuggingface%2Fdiffusers%20freeu&type=code Thank you for reply!

@jyoung105 FreeU is a great work.

And we have supported it in ComfyUI. Here is the workflow:

As I tested, on 3090 RTX, SDXL-base-1.0, 1024x1024, it speedup about 89% ( 3.95 it/s Origin v.s. 7.58 it/s with OneDiff).

I will see the link you prvoide and see how to support it in diffusers.

[jyoung105]

You explained all what I want to say. Thanks! And great works too 💪

[doombeaker]

I'm sorry, things are not as simple as they seem. I found that the workflow in ComfyUI can run, but it did not apply the effect of FreeU. Adding enable_freeu directly in diffusers code will also cause an error when building the OneDiff static graph. However, we will solve these problems, and will tell you in this issue after solving them.

[zhangp365]

FreeU is very useful, wish Onediff supports it. thank you very much.

[jyoung105]

What an amazing compiler, thanks!