ViT-cifar10-pruning Question about vitprune.py code

Question about vitprune.py code

Open wonkicho opened this issue 3 years ago • 1 comments

hello

i wonder what does mean about '[16,40,64,88,112,136]' values of list!!

Sep 23 '22 05:09 wonkicho

hello

i wonder what does mean about '[16,40,64,88,112,136]' values of list!!

These values denote the layer index for Attention, and the pruning ratio needs to be adjusted to ensure that dim is divisible by heads.

Nov 29 '22 09:11 haodonglu