Leo Jiang
Leo Jiang
Can you try regarding #9829 ? I have saved memory by implementing this :)
@sayakpaul Please take a look at this PR, thank you!
@sayakpaul Please take a look at this PR, thank you!
I will pause this PR for this moment, because it needs to some tests with FSDP2 in FLUX.2. Sorry for the inconvenience.
@sayakpaul @yiyixuxu The Flux.2 has been tested as well. The performance also increased. Thank you for your time :)
@yiyixuxu @sayakpaul Please let me know if there is any improvement for this PR, and thanks for your help!
@yiyixuxu I've fixed the code quality issue, please approve the workflow. Thanks
@yiyixuxu Sorry about my mistake, could you please approve the workflow? Thanks
@yiyixuxu Thanks for the information!
Hi @yiyixuxu , Sorry for the trouble, I think there is something wrong with the ruff in my env as there is no code quality in my end. But I...