depthai icon indicating copy to clipboard operation
depthai copied to clipboard

[Feature-Request] Add SOT models: ATOM and Dimp18 to model zoo

Open franva opened this issue 4 years ago • 3 comments
trafficstars

Start with the why:

SOT (Single Object Tracking) is very helpful in many cases, e.g. a following bot, target tracking etc. The ATOM and DiMP-18 models are SOTA models which won competitions in ICCV 2019 and I have tested all 9 models in the model zoo of PyTracking and these 2 are relatively quickest and less demanding among other models.

Move to the what:

I would like Depth AI to add the ATOM and DiMP-18 to its model zoo and create a demo code for these 2 models.

Move to the how:

None.

I did notice that the demos from DepthAI have already have a few object tracking samples, however none of these sample code can perform what the ATOM and DiMP can do, e.g. you can select a particular area on a person(that's right, not necessary the entire body) e.g. left eye, right arm, nose, even a part of your belly, then the 2 models can perform incredible tracking accuracy.

I have found the 2 pre-trained models for your convenience:

  1. ATOM
  2. DiMP-18

Hopefully, some talented devs could help to add these 2 models into the DepthAI's ammunition :)

franva avatar Sep 18 '21 13:09 franva

Thanks. Tagging @tersekmatija in case he hasn't seen these already.

Luxonis-Brandon avatar Sep 21 '21 04:09 Luxonis-Brandon

hi @ersekmatija , when you are migrating ATOM to the blob format, there are something to avoid, e.g. PrPool Which is mentioned here

franva avatar Sep 21 '21 09:09 franva

Hi @franva , thanks for sharing this! I agree that such tracking would be better and would have better accuracy than what we have currently available. I'll look into this, but as this will probably require some implementation of additional tracking logic (not just simple forwards through the NN), I am not sure how soon I'll be able to implement that due to some other projects that we have.

But this is definitely on my TODO list. Of course, you are welcome to help out through pull requests in case you manage to get this working before me :)

tersekmatija avatar Sep 21 '21 12:09 tersekmatija