pix2pixHD icon indicating copy to clipboard operation
pix2pixHD copied to clipboard

strange image artifact in training and testing

Open crypticsymmetry opened this issue 5 years ago • 4 comments

not sure whats happening here. i get these strange artifacts that appear during training and testing. i have tried changing learning rate with no effect. Any help would be much appreciated! Thanks.

output_0016_synthesized_image output_0011_synthesized_image

crypticsymmetry avatar Jul 08 '19 18:07 crypticsymmetry

Gans is unstable

nile649 avatar Jul 24 '19 21:07 nile649

Same problem as https://github.com/NVIDIA/pix2pixHD/issues/46 - it's a problem that haunts me since years - also pix2pix has it. I still have not found the cause, but once a model has caught these types of artifacts there seems to be no way to get rid of them, so you might want to restart the training again from scratch.

Quasimondo avatar Nov 25 '19 18:11 Quasimondo

I'm positive this kind of artifacts are caused by nn.Tanh that produces the final generator output. Maybe it is too complicated for the model to learn to utilize the full range of [-1, 1]. Or there are some misalignments in the input normalization methods used in this repo.

Switching to nn.Sigmoid completely eliminates these artifacts for me. Of course, you need to modify some input normalization methods and im2tensor and tensor2im functions to accomodate for this change.

Zephyr69 avatar Feb 09 '24 07:02 Zephyr69

你好,邮件已收到,祝你万事如意,生活愉快!

zhangxiaojuan66 avatar Feb 09 '24 07:02 zhangxiaojuan66