White-box-Cartoonization icon indicating copy to clipboard operation
White-box-Cartoonization copied to clipboard

Train model with self dataset

Open CodingMice opened this issue 4 years ago • 19 comments

Nice job! I train model with myself dataset. But I find that the results of pretrained model has a lot of noise. And it also happens in the final results. I can not find the reason.

CodingMice avatar Apr 13 '20 02:04 CodingMice

Otherwise, if I just cartoonization face image, can I use face segmetation inplace the the Structure representation.

CodingMice avatar Apr 13 '20 02:04 CodingMice

In case of noise, I guess it was because of the guided filter layer. you can try to train a model without the guided filter in the generator and then add it when inference, you can also try to tune the parameters (r and eps). As for the face segmentation, i have no idea because I have not tried this method.

SystemErrorWang avatar Apr 13 '20 14:04 SystemErrorWang

Noise always appear in the results of train.py, while in the results of cartoonize.py I could not find noise.

zhiguangyang avatar Apr 15 '20 06:04 zhiguangyang

@SystemErrorWang Nice job, but when I used my own dataset to train, It has a bug in utils.py's function simple_superpixel 'batch_out = Parallel(n_jobs=num_job)(delayed(process_slic)
(image) for image in batch_image)' ValueError:'kind must be either 'overlay or avg'', I can not find the reason. Thankyou.

itomorrower08 avatar May 18 '20 07:05 itomorrower08

@itomorrower08 This may be because of environment conflict. In my own experiment, tensorflow=1.12.0/1.13.0, scikit-image==0.14.5 and joblib==0.13.0.

SystemErrorWang avatar May 18 '20 07:05 SystemErrorWang

@SystemErrorWang Thankyou, It's ok. I also want to know whether the VGG19model that download from other places will also be ok? Because I cannot find the ''vgg19_no_fc.npy' in your git. And whether the training data must be resized into 256*256 .

itomorrower08 avatar May 18 '20 07:05 itomorrower08

@itomorrower08 https://drive.google.com/open?id=1JfJzJbNjAWBIHGm9mc_R9dXv7DAw3tZc you can download this file here

SystemErrorWang avatar May 18 '20 07:05 SystemErrorWang

@SystemErrorWang It's useful, thanks. By the way, how many training data(cartoon_photo and face_photo) do you use in this project?

itomorrower08 avatar May 20 '20 08:05 itomorrower08

@itomorrower08 scenery photo:cyclegan training set;scenery cartoon:miyazaki hayao 3617 + hosoda mamoru 5107 + shinkai makoto 5891;face photo:ffhq 00000-10000;face cartoon:pa works 5000 + kyoto animation 5000

SystemErrorWang avatar May 26 '20 07:05 SystemErrorWang

@SystemErrorWang may I ask what's the dataset of scenery cartoon look like? Does it only contains landscape? Or it contains buildings, food, streets, city, campus and many other topics?

Xinxiang7 avatar Jun 16 '20 03:06 Xinxiang7

@Xinxiang7 we used the dataset provided in CycleGAN repository for scenery dataset. You can select the first 5000 images or use all 6227 images, this will only cause minor differeces.

SystemErrorWang avatar Jun 16 '20 03:06 SystemErrorWang

@SystemErrorWang Thanks very much. I mean the scenery cartoon? Does this contains different topics such as buildings, food, streets, city, campus and so on?

Xinxiang7 avatar Jun 16 '20 04:06 Xinxiang7

@Xinxiang7 yes, it contains a wide variety of scenes and topics. for details of the dataset, please download and check it.

SystemErrorWang avatar Jun 16 '20 04:06 SystemErrorWang

@SystemErrorWang Thanks Very much.

Xinxiang7 avatar Jun 16 '20 05:06 Xinxiang7

Hi, @zhiguangyang . May I have a look at your result. I tried different versions with different paratmeters, but the results are not that good.

Xinxiang7 avatar Jun 18 '20 02:06 Xinxiang7

@SystemErrorWang Could you please share at least one exemplary picture for each training dataset group, as it is not clear from the description how to prepare the data properly. Thank you!

alexanderpoplavsky avatar Jul 06 '20 15:07 alexanderpoplavsky

@alexanderpoplavsky you can download the training set here, but it will be deleted if there're any copy rights issus https://drive.google.com/file/d/10SGv_kbYhVLIC2hLlz2GBkHGAo0nec-3/view?usp=sharing

SystemErrorWang avatar Jul 11 '20 06:07 SystemErrorWang

@SystemErrorWang Thank you very much! I really appreciate your help!

alexanderpoplavsky avatar Jul 11 '20 08:07 alexanderpoplavsky

@alexanderpoplavsky you can download the training set here, but it will be deleted if there're any copy rights issus https://drive.google.com/file/d/10SGv_kbYhVLIC2hLlz2GBkHGAo0nec-3/view?usp=sharing

hi, the dataset has some dirs, such as: scenery cartoon:miyazaki hayao 3617 + hosoda mamoru 5107 + shinkai makoto 5891; when you train, do you use only one dir or all dirs? @SystemErrorWang

lilichu avatar Feb 01 '21 12:02 lilichu