pytorch-timeseries icon indicating copy to clipboard operation
pytorch-timeseries copied to clipboard

Different implementation for ResNet

Open JAEarly opened this issue 1 year ago • 1 comments

I've noticed some differences to the original ResNet code at https://github.com/cauchyturing/UCR_Time_Series_Classification_Deep_Learning_Baseline/blob/master/ResNet.py.

You're missing at BatchNorm right at the start of the network, and also the residual should be added before applying ReLU in the final layer of each ResNet block, not after applying ReLU.

In my experiments, adding the above two changes seems to generate results that better match the original results.

JAEarly avatar Jun 29 '23 14:06 JAEarly