Torch-Pruning icon indicating copy to clipboard operation
Torch-Pruning copied to clipboard

Paper is inconsistent with code ?

Open Yewei-Liu opened this issue 4 months ago • 0 comments

In your paper section 3.3 you said you calculate the regularization term using

Image

During sparsity training, you use the unnormalized importance. You only use the max normalized importance during pruning.

However in your code,

Image

You use the max normalized importance both during sparsity training and pruning.

Is there anything wrong ?

Yewei-Liu avatar Aug 30 '25 17:08 Yewei-Liu