pixel2style2pixel icon indicating copy to clipboard operation
pixel2style2pixel copied to clipboard

Question about training custom data

Open fxcdl opened this issue 2 years ago • 6 comments

Hi, thanks for your code I want to train PSP on my own paired dataset, and the dataset is independent of the face. After I read README and some related questions, I made the following changes: image image then, I successfully run the training code: image

My model is still in training. I have some questions:

  1. Although the code is running, I'm not sure if my settings are correct.
  2. I don't understand the difference between "training the PSP encoder" and other orders, do I only need to use the "training the PSP encoder" order on my dataset.

fxcdl avatar Jun 28 '22 06:06 fxcdl

The settings look fine. I would recommend running with more than 0 workers in order to speed up training time considerably. If you wish to train an encoder (i.e, perform inversion), then you are correct that you want to follow the "training the pSp encoder" portion of the README.

yuval-alaluf avatar Jul 13 '22 17:07 yuval-alaluf

OK,thanks for your reply!

fxcdl avatar Jul 15 '22 01:07 fxcdl

Hi, i trained an encoder on my datasets, and i think the result is abnormal. 499700 this is the result on training datasets which has 556 pair of images. Is my training set too small?

fxcdl avatar Jul 18 '22 06:07 fxcdl

Hi @fxcdl , It seems like you tried uploading some images but the images were not uploaded. In general, 500 images does seem a bit low for training these types of models.

yuval-alaluf avatar Jul 20 '22 18:07 yuval-alaluf

Hi @fxcdl , It seems like you tried uploading some images but the images were not uploaded. In general, 500 images does seem a bit low for training these types of models. 1 aha, is it uploading now?

fxcdl avatar Jul 21 '22 00:07 fxcdl

One option that can help here is to add the moco-based loss to training (using moco_lambda) and if that doesn't help, you can try strong inversion techniques such as restyle, hyperstyle, or PTI, all of which are available and compatible with SG2.

yuval-alaluf avatar Aug 12 '22 05:08 yuval-alaluf