Video-Action-Transformer-Network-Pytorch- icon indicating copy to clipboard operation
Video-Action-Transformer-Network-Pytorch- copied to clipboard

Published 20 hours ago • verified publisher icon ppriyank

Query, key, and value are different from the paper

Open coolbay opened this issue 3 years ago • 0 comments

Hi!

In the paper, it mentions that the query is an ROI, and key and values are from the clip around an ROI. But in this implementation, it seems that all query, key and value are from the features in the same spatial locations. In that case, it will not be able to aggregate another person that the target person is talking to.

Please clarify this I am mistaken. Thank you very much!

coolbay avatar Apr 03 '21 06:04 coolbay