facebookresearch
What is the difference between cotracker online and cotracker offline mode?
What is the difference between cotracker online and cotracker offline mode? Thanks!
Take this with a grain of salt, but the primary distinction is that online mode performs frame-by-frame tracking, allowing it to process video streams of arbitrary lengths—such as live feeds—by analyzing a limited number of frames (I think 8? see model.step) at a time. In contrast, offline mode conducts tracking on the entire video at once.
The advantage of offline mode lies in its higher accuracy, as it leverages both past and future frames to improve understanding of object and camera movement. Conversely, online mode processes each frame independently, relying solely on the currently available data.
However, offline processing requires significantly more memory resources since the entire video must be loaded into memory, whereas online mode only loads a subset of frames at a time. Additionally, offline mode supports backward tracing of feature points.
