FGD icon indicating copy to clipboard operation
FGD copied to clipboard

Some questions about gcblock

Open minhhotboy9x opened this issue 1 year ago • 1 comments

When I read the mmdet/distillation/losses/fgd.py, there is something I can't understand.

  1. In the init function of the FeatureLoss, at the end of that function, after all the initialization, why do they reset params (line 57)? This reset makes the last layers' weights of self.channel_add_conv_t and self.channel_add_conv_s become zeros the outputs of these layers are zeros?
  2. Are Gcblocks trained with student? I think when we use the model for our inferences, the Gcblocks are eliminated so they don't have to train, do they?

minhhotboy9x avatar Oct 05 '23 03:10 minhhotboy9x

  1. The initialization follows gcblock.
  2. yes, gcblock needs to be trained. But we donot need them for inference.

yzd-v avatar Oct 10 '23 01:10 yzd-v