StyleGAN2_PyTorch icon indicating copy to clipboard operation
StyleGAN2_PyTorch copied to clipboard

Why does the activation should product sqrt(2)?

Open joe1chief opened this issue 5 years ago • 3 comments

https://github.com/tomguluson92/StyleGAN2_PyTorch/blob/37741fbadc59c2fb2613248aa5d74f5b9d66de73/network/stylegan2.py#L95

joe1chief avatar Dec 25 '19 13:12 joe1chief

Hi, This way is same with original TF version, used in Leaky ReLU.

tomguluson92 avatar Dec 25 '19 13:12 tomguluson92

Hi, This way is same with original TF version, used in Leaky ReLU. Why did you comment on the following code? Is the tanh() necessary? https://github.com/tomguluson92/StyleGAN2_PyTorch/blob/37741fbadc59c2fb2613248aa5d74f5b9d66de73/network/stylegan2.py#L913

joe1chief avatar Dec 25 '19 14:12 joe1chief

Hi, This way is same with original TF version, used in Leaky ReLU. Why did you comment on the following code? Is the tanh() necessary? https://github.com/tomguluson92/StyleGAN2_PyTorch/blob/37741fbadc59c2fb2613248aa5d74f5b9d66de73/network/stylegan2.py#L913

I try to restrict the output data fall in [-1, 1], which the original TF version didn't do that.

tomguluson92 avatar Dec 27 '19 11:12 tomguluson92