CycleGAN icon indicating copy to clipboard operation
CycleGAN copied to clipboard

Image colorization of grayscale images.

Open ArkaJU opened this issue 5 years ago • 5 comments

I am working on an image colorization problem. I made the dataset by downloading black and white/colored movies from youtube and extracting frames from them. But I am not getting the desired very good results. Dataset size is 2k images each and was trained for about 40 epochs. Some results are shown below:

screenshot_2018-10-20 tensorboard 1 screenshot_2018-10-20 tensorboard screenshot_2018-10-19 tensorboard 5 screenshot_2018-10-19 tensorboard 4

Can you give some pointers on how to get better results, or whether it is indeed possible for CycleGAN to colorize a grayscale image. Thank you.

ArkaJU avatar Oct 21 '18 10:10 ArkaJU

2K might not be enough. Researchers often trained the colorization models using millions of RGB images. See the colorization-pytorch repo for more details.

junyanz avatar Oct 21 '18 19:10 junyanz

Thanks. If I just increase the number of RGB images with number of black and white images constant, is it fine?

ArkaJU avatar Oct 22 '18 04:10 ArkaJU

You can also train the model with a paired dataset. See the colorization-pytorch and this paper for more details.

junyanz avatar Oct 22 '18 13:10 junyanz

Actually paired data is not available for this problem.

ArkaJU avatar Oct 23 '18 04:10 ArkaJU

You can create paired data by converting RGB to grayscale images. Please look at the paper for more details.

junyanz avatar Oct 23 '18 13:10 junyanz