Two issues regarding the implementation

[hubert0527]

Thanks for your interest in COCO-GAN and your effort in implementing it in Pytorch!

I took a quick look and found two issues (not sure if there is still any other) that may cause your model failed to converge:

1. The implementation of CBN is wrong, the mean_rec and var_rec needs to be tracked for each iteration. It should work very similarly to the standard batch norm. You may refer to this: https://discuss.pytorch.org/t/conditional-batch-normalization/14412/2

2. You will have to implement a GPU version for micro-patch-to-macro-patch conversion. Otherwise, there will be no gradient propagation from the discriminator for the generator adversarial training.