Depth other than 1 does not work

[B-lanc]

Changing the depth to anything other than 1 will result in this error

RuntimeError: Given groups=1, weight of size [512, 512, 5], expected input[1, 1024, 357] to have 512 channels, but got 1024 channels instead

I am pretty certain this is the cause of said error https://github.com/f90/Wave-U-Net-Pytorch/blob/443fe306ee921db202e3084514aa2770e6e147ec/model/waveunet.py#L24 and https://github.com/f90/Wave-U-Net-Pytorch/blob/86c113da51540c94b01a91fbf17227f0e9c3c274/model/waveunet.py#L38

line 24 implies that the next modules will not take the shortcut (n_outputs as opposed to n_outputs+n_shortcut) while line 38 adds the shortcut after the first iteration.

It should be either all post shortcut convs to take the added shortcut, or the shortcut is only added once. I think the latter makes more sense, though.