axial-attention
axial-attention copied to clipboard
can i use axial position embedding on 3D images directly?
hi, thanks for your effort and great work,
I am working on the 3D image, I want to apply axial attention to the transformer, I am wondering if can i use axial position embedding directly on the 3D image.