ControlNet-v1-1-nightly icon indicating copy to clipboard operation
ControlNet-v1-1-nightly copied to clipboard

how to filter low quality iamge and improve my model quality

Open nairoj opened this issue 1 year ago • 0 comments

I tried training myself to train controlnet, but my results were poor on portraits and good on non-human images.

type from to
non-human image image
portraits image image

The questions that often come up on portraits are

  1. The resulting images have weird colors, for example, like image
  2. The picture quality is low image

I have used 400,000 image-text data to create 400,000 depth data and depth_leres data. I trained the model for 4 epochs with a batch size of 256 (using gradient accumulation) to obtain the results mentioned above.

I would like to have some empirical guidance on what may have gone wrong with my training. Do I need to add more data to improve the quality of the results? Is there any way to filter out low-quality images (like image with JPEG artifacts) in the dataset?

nairoj avatar Jun 12 '23 09:06 nairoj