lightly icon indicating copy to clipboard operation
lightly copied to clipboard

Grad-CAM or attention map

Open s9021025292140 opened this issue 1 year ago • 1 comments

Would it be possible to add functionality for Grad-CAM or attention map similar to those used in DINO?

Thank you!

s9021025292140 avatar Jul 15 '24 15:07 s9021025292140

Hi! For Grad-CAM it is probably best if you just use the grad cam library: https://github.com/jacobgil/pytorch-grad-cam For the attention map visualization from DINO (here) the issue is mostly on how to make it work with other models than DINO. I guess it should be possible for any TIMM vision transformer, would definitely be a nice addition!

guarin avatar Jul 16 '24 10:07 guarin