VL-BERT icon indicating copy to clipboard operation
VL-BERT copied to clipboard

visualize attention for custom images

Open betterze opened this issue 4 years ago • 0 comments

Dear @huangyz0918 and @jackroos ,

Thank you for sharing with us the great work, it is impressive.

Is there a easy way to visualize attention for custom images? For example, in ./viz/model_view_vl-bert_coco.ipynb, you show attention visualization for coco images, what if I want to use my own images? It does not seem easy to generate attention map through vis_attention_maps.py for a single image.

Thank you for your help.

Best Wishes,

Alex

betterze avatar Jan 08 '21 22:01 betterze