co-tracker icon indicating copy to clipboard operation
co-tracker copied to clipboard
verified publisher icon facebookresearch

Inference with sequence of multiple images for a particular single pixel using co-tracker2

Open pknmax opened this issue 2 years ago • 3 comments

How to do inference with sequence of multiple images for a particular single pixel? Is there a way to select this pixel in first image?

pknmax avatar Jan 08 '24 15:01 pknmax

Hi @pknmax, please see the "Tracking manually selected points" section in the Colab Demo to see how to do it. Note that tracking individual points works best with support point grids , which are used by default in the CoTrackerPredictor class and discarded at the output.

nikitakaraevv avatar Jan 08 '24 15:01 nikitakaraevv

Hi @nikitakaraevv ; thanks for the reply. does the model manage to track the pixel if it has specular color (view dependent appearance) and changes colors after few frames?

pknmax avatar Jan 11 '24 14:01 pknmax

Hi @pknmax, the model works for such pixels in some cases, but not always.

nikitakaraevv avatar Jan 22 '24 20:01 nikitakaraevv