efficient-attention
efficient-attention copied to clipboard
dimension problem
the input dimension is (1, 128, 32, 32) or (1, 256, 16, 16). I try to use efficient attention ,but the memory and Gflops are still big
Could you provide more specific numbers (i.e. exact FLOPs and memory)?