[Pipeline] FRESCO

[a-r-r-o-w]

Model/Pipeline/Scheduler description

https://github.com/huggingface/diffusers/assets/72266394/a0f2a4d9-ed6e-403e-8a44-f53a9831467d

Open source status

• [X] The model implementation is available.
• [X] The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

Paper: https://arxiv.org/abs/2403.12962 Code: https://github.com/williamyang1991/FRESCO Project page: https://www.mmlab-ntu.com/project/fresco/ Authors: @williamyang1991, @SingleZombie, Ziwei Liu, Chen Change Loy

[sayakpaul]

Already uses diffusers: https://github.com/search?q=repo%3Awilliamyang1991%2FFRESCO%20diffusers&type=code.

diffusers is slowly also becoming a library that provides building blocks to the practitioners to do things. In cases like this, we would want to refer users to the original implementations as opposed to making it a part of the library because IMO that honors the efforts of the authors better. @yiyixuxu WDYT?

[rootonchair]

So should we convert this project into a diffusers Pipeline @sayakpaul? Although the author already uses diffuser component, we would still need some refactoring for ease of use

[SingleZombie]

Hi, I am the author of the paper. I have implemented our previous work Rerender in Diffuers. If you want to reimplement FRESCO in Diffusers, I can offer help.

[sayakpaul]

Yes, a community pipeline will be greatly appreciated <3

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.