Homography-Based-MOTDT

• Term project results for AAA534 <Computer Vision> in Korea University
• This work is based on MOTDT which is one of the state-of-the-art algorithm for real-time multiple object tracking
  • code: https://github.com/longcw/MOTDT
  • paper: https://arxiv.org/abs/1809.04427
• For more information, please refer to the report file in this repository

Overview

• STEP1: Estimate bounding box of frame t+1 from the current frame t through Kalman Filter
• STEP2: Detect object at time t+1 using R-FCN
• STEP3: Filter objects estimated in STEP1 and objects detected in STEP2 through Non-Maximum Suppression
• STEP4: Calculate homography matrix from frame t and t+1
• STEP5: Create candidates by linearly transforming the existing object at time t through homography matrix obtained in STEP4
• STEP6: Allocate bounding box candidates from STEP3 and STEP5 to each object based on IOU and ReIE features.

Tracking Examples

MOT17 Dataset

MOTDT (original)

• The original model cannot maintain the track ID of object 1 (turned to 101), which is covered by object 105

Homography Based MOTDT (proposed)

• Ours maintains the track ID of object 1 and 89 even though they are obscured by object 161 carrying a green bag.

VisDrone Dataset

MOTDT (original)

• The original model cannot maintain the track ID of object 427 (turned to 509) due to a sudden change in camera angle

Homography Based MOTDT (proposed)

• Ours maintains the track ID of object 515 even though there is a sudden change in camera angle at the end of the clip

Results

MOT17 Dataset

VisDrone Dataset

Implications

• There has been a clear trade-off between the original and proposed method
• False Positive increased a lot with additional bounding boxes generated by Homography, while Mostly Tracked measure which means the tracking success in the 80% of whole frames improved
• Additionally, number of misses and number of fragments decreased considerably because of supplementary bounding boxes
• Tracking time increased enormously, which is main downside of proposed method