Stark icon indicating copy to clipboard operation
Stark copied to clipboard

What is the role of adjust function?

Open hongsheng-Z opened this issue 3 years ago • 1 comments

Hi, why do you use the function adjust after backbone? Can we directly input it into the transformer without any adjustment

hongsheng-Z avatar Dec 01 '21 13:12 hongsheng-Z

Hi, the role of adjust is to (1) reduce the number of channels (typically from 1024 to 256) (2) add positional encoding, which is needed by Transformer (3) add "padding mask" to indicate where is the image and where is padding.

MasterBin-IIAU avatar Dec 04 '21 09:12 MasterBin-IIAU