sd-scripts icon indicating copy to clipboard operation
sd-scripts copied to clipboard

Does flux-dev or flux-fill support paired data training for LoRA?

Open huxian0402 opened this issue 9 months ago • 2 comments

I would like to train a LoRA model for object removal using paired object removal data based on flux-dev or flux-fill. The paired data includes the original image, the mask image of the object to be removed, and the target image (the image after the object has been removed). Does the current code support this? Do you have any suggestions? @lansing @rockerBOO @akx @tsukimiya @wkpark

huxian0402 avatar Apr 10 '25 13:04 huxian0402

I developed a paired dataset system for preference optimization but it needs another pass to bring it up a good standard. The whole dataset system is a little confusing so might be an opportunity to consider improvements to allow for more flexibility. I was going to be making another pass on my preference optimization soonish so I might propose some improvements there that would allow paired or greater batches for doing associated images in training.

rockerBOO avatar Apr 10 '25 22:04 rockerBOO

I have the same question. Did you solve it? @huxian0402

hnsywangxin avatar Jul 16 '25 12:07 hnsywangxin