Visualize the attention weights

[code-pan94]

Hello,

I am wondering how can we visualize the attention maps as in the original ViT paper. I tried several strategies but I failed unfortunately.

Thanks in advance.

[WAMAWAMA]

https://github.com/WAMAWAMA/trans_attention_vis maybe you can try this

but more novel method to visualize the attention maps is like: https://github.com/hila-chefer/Transformer-Explainability https://github.com/hila-chefer/Transformer-MM-Explainability