How do you visualize attention weights?

[tomegai]

Thanks for sharing the great work.

I would like to reproduce the paper's visualization results for the decoder self-attention weights in Figure 1 and the encoder self-attention weights in Figure 8. Please help me.

• How do you visualize attention weights?
• Does "all points in the scene" mean no down sampling?
• Which layer and which head's attention weights did you visualize?
• Could you share the code for the attention weights visualization?

Thank you.