FisherPruning icon indicating copy to clipboard operation
FisherPruning copied to clipboard

Release of mask RCNN and multi head FisherPruning

Open itsMorteza opened this issue 3 years ago • 6 comments

Hi, The loss in Groups is computed based on bbox loss; what is the best way to integrate it with mask loss? Thanks, image

itsMorteza avatar Oct 29 '21 16:10 itsMorteza

The loss is as usual, I think you can use the normal mask loss such as BCE.

liyangliu avatar Nov 03 '21 03:11 liyangliu

I used forward_dummy format from mmdetection with using another fork however, it couldn't compute fisher in backward format(tensor size problem). is there any good implementation for two stage detector or segmentation loss? Thanks, image

itsMorteza avatar Nov 04 '21 02:11 itsMorteza

I used forward_dummy format from mmdetection with using another fork however, it couldn't compute fisher in backward format(tensor size problem). is there any good implementation for two stage detector or segmentation loss? Thanks, image

Hi, I have meet the same problem when compute fisher of faster rcnn. Have you solved this problem?

mls1999725 avatar Nov 09 '21 06:11 mls1999725

Unfortunately, no. Even with trial and error, the pruned model couldn't be fine-tuned. the problem initiated with the multi-pass loss; then it couldn't find the whole ancestors very well to make groups.

itsMorteza avatar Nov 09 '21 17:11 itsMorteza

Have you checked whether all the layers that are supposed to be in one group are gathered correctly by the algorithm?

liyangliu avatar Nov 12 '21 03:11 liyangliu

Inside compute fisher backward hook it couldn't update temp fisher info for mask head and linear side wherein the temp fisher info is not same as the result of computing fisher. image

itsMorteza avatar Nov 13 '21 01:11 itsMorteza