Synaptic-Flow

Synaptic-Flow copied to clipboard

All gradients are zero for synflow

2

I was using synflow for my resnet like model for a classification problem. I found that all gradients of the masked_parameters are zeros. Any ideas why it happens? `self.scores[id(p)] =...

jackmvision

Hi, thank you for for the impressive work. I was wondering if you could consider adding license to the repo so that we can use your code for research.

YiteWang

In single-shot experiments using SynFlow as the pruner, it is very likely that the 1x1 convolutional layers are completely pruned out. A command to reproduce this observation is: `python main.py...

xhchrn

Hello, I have some questions about your code. - I could not understand where the loop from Algorithm 1 of the paper is on the code, if it is the...

AndreydeAguiarSalvi

Bumps [torch](https://github.com/pytorch/pytorch) from 1.4.0 to 2.2.0. Release notes Sourced from torch's releases. PyTorch 2.2: FlashAttention-v2, AOTInductor PyTorch 2.2 Release Notes Highlights Backwards Incompatible Changes Deprecations New Features Improvements Bug fixes...

dependabot[bot]