axial-attention icon indicating copy to clipboard operation
axial-attention copied to clipboard

can i use axial position embedding on 3D images directly?

Open Uljibuh opened this issue 10 months ago • 0 comments

hi, thanks for your effort and great work,

I am working on the 3D image, I want to apply axial attention to the transformer, I am wondering if can i use axial position embedding directly on the 3D image.

Uljibuh avatar Apr 24 '24 09:04 Uljibuh