VoxFormer icon indicating copy to clipboard operation
VoxFormer copied to clipboard

Published 20 hours ago • verified publisher icon NVlabs

Question about attention.

Open zhyzhyzhy123 opened this issue 1 year ago • 0 comments

Hello there! The work and code is amazing. But I have some question about the code, in deformable_*_attention.py, the attention weight is from a linear transform from query, I do not understand why the attention weight is unrelevent to the key.

zhyzhyzhy123 avatar Jan 23 '24 09:01 zhyzhyzhy123