ViT-pytorch icon indicating copy to clipboard operation
ViT-pytorch copied to clipboard

Why we need to calculate residual connections when visualize attention maps?

Open JamenceTom opened this issue 2 years ago • 3 comments

Thanks for your great job! I am curious why we need to calculate residual connections when visualizing attention maps? image

JamenceTom avatar Dec 16 '21 07:12 JamenceTom