IF icon indicating copy to clipboard operation
IF copied to clipboard

Variance Scheduler

Open sai-advaith opened this issue 1 year ago • 2 comments

I am using DeepFloyd locally with Stage I medium, T5 medium, and stage II medium. I noticed that if I were to modify the variance scheduler for sampling to linear from cosine, the sample results are much worse than with a cosine scheduler.

Is there a reason why this happens? And, is there a way DeepFloyd can work well with a linear scheduler too?

sai-advaith avatar Nov 25 '23 21:11 sai-advaith

i discover the same question too.Do u have any progress on this issue?

ShaochengShen avatar Mar 05 '24 13:03 ShaochengShen

DeepFloyd was trained with a cosine schedule.

bghira avatar Apr 28 '24 14:04 bghira