Lottery-Ticket-Hypothesis-in-Pytorch icon indicating copy to clipboard operation
Lottery-Ticket-Hypothesis-in-Pytorch copied to clipboard

why my experiment results can't reach the original performance?

Open JaminLi opened this issue 4 years ago • 1 comments

Hi, thanks for your nice repo! When I used your method for my experiment, I found my experiment results can't reach the original performance whether the first iteration or the 35th iteration.

In <main.py> #Freezing Pruned weights by making their gradients Zero grad_tensor = np.where(tensor < EPS, 0, grad_tensor)

Does this issue?

JaminLi avatar Sep 28 '20 09:09 JaminLi

In my implementation, I refactored all of the NumPy operations to the PyTorch ones. It worked, and the accuracy can reach training from scratch.

l1teng avatar Sep 22 '22 13:09 l1teng