Samuel Ofosu Mensah

It uses about 13.00 GiB so if your GPU memory is less than that, you may get excessive memory usage problem. Maybe you should reduce the batch size to resolve...

I don't know why it is so but this is how it looks like at the moment. Check the `GPU Process 1` 

I agree with you. This is very costly.

I am also having the same issue. Did you solve it yet?

Hello @ShairozS, did you get a code to extract the attention map? If you did, can you share?