Implement: Align Your Steps: Optimizing Sampling Schedules in Diffusion Models

[joe-aivatarz]

Align Your Steps: Optimizing Sampling Schedules in Diffusion Models is a general and principled approach to optimizing the sampling schedules of DMs for high-quality outputs. This work is presented by Nvidia labs in this paper: https://arxiv.org/abs/2404.14507

and the project page is here https://research.nvidia.com/labs/toronto-ai/AlignYourSteps/

the page propose a very small change that have big impact on the inference quality

[atxoxx]

already implemented here : https://github.com/comfyanonymous/ComfyUI/commit/644a3ae58d426ffbbc02ef4104034c98e8fc6513

[giteeeeee]

Can anyone explain how to use this node?

It has a SIGMAS output which I'm not sure where it should link to.

[ltdrdata]

Can anyone explain how to use this node?

It has a SIGMAS output which I'm not sure where it should link to.

[ecpknymt]

So can I use SamplerCustom node for denoise img2img? I cant find how to handle denoise step...

[ltdrdata]

So can I use SamplerCustom node for denoise img2img? I cant find how to handle denoise step...

Sure... That is similar to KSamplerAdvanced. You need to manipulate sigmas to mimic denoise.

[frankyifei]

Maybe this should be implemented in system's scheduler list, then lots workflow should benefit from it.

[ErvinA-wx]

Can anyone explain how to use this node? It has a SIGMAS output which I'm not sure where it should link to.

升级comfyui到最新版本直接就可以用这个节点。或者双击左键搜索“AlignYourStepsScheduler”，这个节点就出现了。

[quixot1c]

@joe-aivatarz why don'y you close the issue when it was already implemented?

[427067]

AlignYourStepsScheduler 倍速高质量（质量强过lcm hypersd）10步多伦多.json

[Koitenshin]

This really is the most pain in the butt way to use AYS.

Hey @comfyanonymous, can you finally add AYS to the other schedulers so we can stop jumping through hoops to use it? You're already adding new samplers & schedulers we never had before.