Autofocus-Layer icon indicating copy to clipboard operation
Autofocus-Layer copied to clipboard

Published 20 hours ago • verified publisher icon yaq007

question about the autofocus implementation

Open miracle-fmh opened this issue 5 years ago • 2 comments

In https://github.com/yaq007/Autofocus-Layer/blob/master/models.py Line 180 why do you use x.detach?

miracle-fmh avatar Mar 04 '19 03:03 miracle-fmh

Here we do not want the attention map to influence the weights update in the main branch. Therefore, we use x.detach to treat the features extracted from the main branch as an independent input to the attention module.

yaq007 avatar Mar 09 '19 04:03 yaq007

if we use x.detach, then how can i update the weights of the convs (such as convatt1, convatt12) on the attention branches ?

miracle-fmh avatar Mar 12 '19 06:03 miracle-fmh