CVPR2022_STNet icon indicating copy to clipboard operation
CVPR2022_STNet copied to clipboard

Video Frames Data Preprocessing

Open BasitAlawode opened this issue 2 years ago • 1 comments

I want to use STNet for tracking my own video frames. How can I obtain the im_x_pos, im_x_neg, and snn_state in line 211 of stnet_track.py?

Also, what is the value of snn_state_first in the init function line 169 stnet_track.py?

BasitAlawode avatar Apr 02 '22 21:04 BasitAlawode

im_x_pos and im_x_neg are aggregated by recording the spatial positions of all occurred negative and positive events during the period, respectively.

The _snn_state first definition in the tracking initialization is on line 99 of videoanalyst/engine/tester/tester_impl/utils/got_benchmark_helper.py

The membrane potential and spiking in snn_state will be updated with the input of temporal information (i.e., each event frame in the sequence).

Jee-King avatar Feb 18 '23 14:02 Jee-King