AdaFocus icon indicating copy to clipboard operation
AdaFocus copied to clipboard

Hi,the segment_indices_glancer is different from segment_indices_focuser in Something. what is the purpose?

Open xusong-20 opened this issue 2 years ago • 1 comments

And the number of num_segments_glancer is different from the number of num_segments_focuser. 但是论文Figure 2. Overview of AdaFocus. 中 输入到fG网络 和 fL网络的帧是一一对应的。请问,输入到fG网络 和 fL网络的帧的需要是一一对应的吗?

xusong-20 avatar Oct 27 '21 11:10 xusong-20

On Something-something dataset, we found that fG and fL do not have to correspond strictly. In Table 3, TSM+ uses 8 frames for both fL network. In contrast, we reduce the input size of the relatively expensive fL network to 144x144/160x160/176x176 in AdaFocus-TSM, which enables fL network to process more frames in the task-relevant region of each video using the same computation, leading to a significantly improved efficiency.

jianghaojun avatar Oct 29 '21 07:10 jianghaojun