TransFG icon indicating copy to clipboard operation
TransFG copied to clipboard

about Part Selection Module

Open zerooooone opened this issue 1 year ago • 0 comments

Thanks for your great work! I have a question about selecting tokens with maximum activation in Part Selection Module. In Eq.6, is a_l^i the attention-score calculated separately for the class token and other N tokens? So the dimension of a_l^i is N right? image

zerooooone avatar Jan 23 '24 04:01 zerooooone