Belegkarnil

Ok, I'll try but why to provide a statefull ReLU Layer? Is it for a specific purpose?

I compared my implementation to other frameworks and it is the same shapes. Moreover the forward pass does not cause any issue, it is the backward pass. This is why...

Ok thanks a lot ! I assumed that it works like other frameworks but that the result of AvgPool has a different shape.