sd-scripts icon indicating copy to clipboard operation
sd-scripts copied to clipboard

Wavelet loss function?

Open nitinh12 opened this issue 8 months ago • 4 comments

Is wavelet loss function supported for flux? @kohya-ss

nitinh12 avatar Mar 29 '25 10:03 nitinh12

https://arxiv.org/abs/2306.00306 https://arxiv.org/abs/2402.19215 https://arxiv.org/abs/2211.16152 https://arxiv.org/abs/2407.12538

Looking into this but some related papers.

rockerBOO avatar Apr 07 '25 05:04 rockerBOO

https://arxiv.org/abs/2306.00306 https://arxiv.org/abs/2402.19215 https://arxiv.org/abs/2211.16152 https://arxiv.org/abs/2407.12538

Looking into this but some related papers.

Thanks for sharing these. It would be great if this gets added for flux training. AI toolkit recently implemented this.

nitinh12 avatar Apr 07 '25 10:04 nitinh12

@rockerBOO Any update on your PR?

nitinh12 avatar Apr 19 '25 09:04 nitinh12

@nitinh12 I am using it every day, multiple times a day. It is working as expected but I have been testing some other things. Also waiting to hear from a few people who are trying it.

rockerBOO avatar Apr 19 '25 16:04 rockerBOO