iou-tracker icon indicating copy to clipboard operation
iou-tracker copied to clipboard

V-IOU tracker improvements implementation ?

Open tdurand opened this issue 5 years ago • 23 comments

Hello,

Is the v-iou implementation available somewhere ? (based on paper Extending IOU Based Multi-Object Tracking by Visual Information)

I'm doing something close to V-IOU idea in a node.js implementation: https://github.com/tdurand/node-moving-things-tracker but in a much less "academic" way.

There is not much details about the "prediction" method you use for the visual tracking.. On my project I'm using velocity / acceleration vectors but do not change the bounding box width / height

From you paper, I'm gonna try this idea of searching "back-wards through the last ttl frames for each new track" , this is something I'm not doing currently

Thanks !

Thibault

tdurand avatar May 28 '19 10:05 tdurand

Hi,

I had not time to cleanup and publish the code yet. I am not sure when this will happen, but it is definitely on my todo list.

For the prediction I am using a visual single object tracker (e.g. KCF is fast and reliable, at least for a couple of frames). Maybe a kalman filter is more suitable for your javascript application?

bochinski avatar Jun 11 '19 14:06 bochinski

Hi, thanks for your comment ! I'll look into KCF and Kalman filter... For now our implementation is giving good enough results but we didn't benchmark it really well. We have a very basic prediction method.

Feel free to close this if you want.. And I'm glad you will eventually publish the code at some point.

Best

tdurand avatar Jun 11 '19 14:06 tdurand

I will leave this open for reference since some people already asked about this by mail.

bochinski avatar Jun 14 '19 13:06 bochinski

@bochinski

Kalman is good but ...it is a cpu killer. Using width,height and nearness with t-1 frames with time < 6 seconds will increase accuracy.

jamessmith90 avatar Jun 17 '19 11:06 jamessmith90

Congrs V-IOU is the top3 in the tracking challenge on MOT19 from yesterday's CVPR meeting, look forward to see its implementation!

lynnw123 avatar Jun 18 '19 04:06 lynnw123

@jamessmith90 I agree, but nothing is for free. Visual single object tracking/optical flow works much better (especially when the target movement is non-linear) but is much more cpu intensive. It really depends on what you want to achieve and what you can settle with.

@lynnw123 thank you very much, unfortunately I was not able to attend this years CVPR on short notice but I assume it was a great workshop. Anyway, this is a good motivation for me to publish the code sooner than later.

bochinski avatar Jun 18 '19 16:06 bochinski

@bochinski Looking forward to your v-iou implementation.

jamessmith90 avatar Jun 24 '19 13:06 jamessmith90

@bochinski Congrats for your position in MOT19.

Do you have plans to release the updated version ?

dexception avatar Sep 17 '19 14:09 dexception

@dexception thanks!

I already started working on the code but wasnt able to finish it yet as something else came in between. Hopefully there are no more problems/delays so you can expect the release of the code very soon.

bochinski avatar Sep 20 '19 13:09 bochinski

@bochinski Can you share a timeline with us ?

dexception avatar Sep 29 '19 09:09 dexception

@bochinski Kindly provide some info.

suman-19 avatar Oct 25 '19 08:10 suman-19

@dexception @suman-19 Sorry about the delay, I know that a few people are waiting on this. My original time line was to do this months ago but every time I want to start on this something else comes in between. I will try to do this sometime in the next weeks and I sincerely hope that I can keep my promise this time.

bochinski avatar Oct 28 '19 12:10 bochinski

Thanks for the update.

dexception avatar Oct 28 '19 21:10 dexception

@bochinski Any progress ?

dexception avatar Nov 30 '19 13:11 dexception

@bochinski Any update ?

jamessmith90 avatar Dec 10 '19 12:12 jamessmith90

I'm also very interested in this

nicolaerosia avatar Dec 11 '19 12:12 nicolaerosia

@bochinski 7 months and still waiting for a release.. :-)

ashuezy avatar Dec 13 '19 10:12 ashuezy

Waiting..

uday60 avatar Dec 18 '19 08:12 uday60

waiting .. :)

penolove avatar Jan 04 '20 10:01 penolove

waiting..

sachingoyal0104 avatar Jan 24 '20 09:01 sachingoyal0104

I finally managed to push the v-iou code. I am sorry for the delay, it took way longer than anticipated. One reason for this is that i decided to completely rewrite my original code to get a clean version that is similar to the iou tracker code. Let me know if you encounter any issues, the results should be the same as in the paper and challenge submissions.

bochinski avatar Jan 29 '20 15:01 bochinski

thank you!

nicolaerosia avatar Feb 01 '20 14:02 nicolaerosia

Hello All,

Any idea how to run this tracker V-IOU for a custom video with real-time detection ?

Thank You !

akshu281 avatar May 19 '20 10:05 akshu281