inpainting-gmcnn-keras icon indicating copy to clipboard operation
inpainting-gmcnn-keras copied to clipboard

Wrong results after Tensorflow 2x model conversion #70

Open sergiocasaspastor opened this issue 3 years ago • 1 comments

Hi,

I hope you still give support for this repository. I tried converting this repository model to Tensorflow 2x step by step (also following the original repository by shepnerd). I think everything was fine, but when training and testing the model the results were not very satisfactory. So, maybe there is a problem with my conversion that I can't find it. I tried to train the model on a small subset of OpenImages V6. The principal parameters that I used (sorry, because names can be slightly different than yours):

--img_size 256x256x3 --batch_size 4 --learning_rate 1e-4 --gaussian_steps 7 --gaussian_kernel_size 32 --gaussian_kernel_std 20.0 --reconstruction_loss_weight 1.2 --adversarial_loss_weight 0.001 --gradient_penalty_loss_weight 10 --id_mrf_loss_weight' 0.03 --nn_stretch_sigma 0.5 --id_mrf_style_weight 1.0 --id_mrf_content_weight 1.0

I pretrained the model with only confidence reconstruction loss for the recommended steps, and results for this phase seem fine.

imagen ![imagen](https:// imagen user-images.githubusercontent.com/39574343/111080637-a3871d00-84ff-11eb-90cb-c6de09d587f6.png)

However, in the training phase, after some steps, the results do not seem to converge and eliminate the mask.

imagen imagen imagen

I would like to know if you have any idea of what could be happening, or you have experienced any similar issue. I reviewed the code, networks, and losses many times, but could not find any solution.

Thank you very much.

sergiocasaspastor avatar Mar 14 '21 19:03 sergiocasaspastor

Message that will be displayed on users' first issue

github-actions[bot] avatar Mar 14 '21 19:03 github-actions[bot]