Tayeb BENZENATI

Visualize the attention weights

1

Hello, I am wondering how can we visualize the attention maps as in the original ViT paper. I tried several strategies but I failed unfortunately. Thanks in advance.

Problem with embedding dimension

1

Hello, Thank you for sharing such a wonderful code. I found in my experiments that the parameter of emb_dim that refers to the embedding dimension should be always a multiple...