diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Support training SD V2 with Flax

Open yasyf opened this issue 3 years ago • 3 comments

Mostly involves supporting a v_prediction scheduler.

The implementation in #1777 doesn't take into account a recent refactor of scheduling_utils_flax, so this should be used instead.

yasyf avatar Dec 20 '22 06:12 yasyf

cc @patrickvonplaten @yiyixuxu @patil-suraj

yasyf avatar Dec 20 '22 06:12 yasyf

The documentation is not available anymore as the PR was closed or merged.

Hey, sorry to ask this here, but I don't know other place for it.

Is v_prediction scheduler only used for SD-2-768 version?

I'm confused that on hugging-face config the 2-1-base(512) uses epsilon link and only 768 uses v_prediction link

bonlime avatar Dec 20 '22 07:12 bonlime

Hey @bonlime that's correct, only the 768 and upscaler models use v-prediction.

patil-suraj avatar Dec 26 '22 12:12 patil-suraj

@patil-suraj done!

yasyf avatar Jan 01 '23 01:01 yasyf

Fixes #1798

pcuenca avatar Jan 04 '23 08:01 pcuenca