Difficulty tracking people with occlusion by tree branches

[masonearles]

First off, thanks for combining Darkflow with DeepSort. I'm really enjoying playing around with it.

Generally, I've found the tracking to be pretty successful when there is limited occlusion by other objects. However, I'm trying to track people when there is occlusion by tree branches (see attached screenshot). As a result, I think that Darkflow is having trouble recognizing these as people -- given the strange lines, aka branches, that are randomly oriented across their bodies. I considered finetuning the existing model with images from some of my videos, but I'm getting stuck. How do you recommend dealing with this issue?

Thanks for any direction!

[obendidi]

you could try adding optical flow , with opencv , it works well with occlusions : https://github.com/akshaychawla/Optical-Flow-Tracking----OpenCV

i'm working on another version of this project with support for multiple object Detectors (Detectron/object detection API, darkflow ) , and multiple tracking algorithms , so that it will be easier to test and find best combinaison

[masonearles]

Thanks for your suggestion. I've been working on testing out optical flow, but am having trouble understanding how to integrate it with your existing code. Can you provide some direction to get me started?