efficient-attention icon indicating copy to clipboard operation
efficient-attention copied to clipboard

An implementation of the efficient attention module.

Results 3 efficient-attention issues
Sort by recently updated
recently updated
newest added

Can you share the code on how to visualize attention maps in object detection like the one shown in your paper? ![image](https://user-images.githubusercontent.com/62779617/155676635-78f1af27-293e-44da-9a68-bf171671d537.png)

the input dimension is (1, 128, 32, 32) or (1, 256, 16, 16). I try to use efficient attention ,but the memory and Gflops are still big

Hello, I have recently implemented a cross attention application with multi-modal fusion, but because the image resolution is too large, cuda OOM occurs when calculating q and k, so I...