neuralet icon indicating copy to clipboard operation
neuralet copied to clipboard

Improve detection box filtering strategies

Open mhejrati opened this issue 6 years ago • 4 comments

We can improve detections using:

  • Scene priors
  • Background/Foreground subtraction and modeling

@alpha-carinae29 & @mrn-mln I suggest you take a look at this.

mhejrati avatar Apr 09 '20 20:04 mhejrati

@mhejrati please move this issue to fine-tuning and calibration milestone

alpha-carinae29 avatar May 16 '20 21:05 alpha-carinae29

I worked on this issue in last days. I have implemented a background subtraction with cv.createBackgroundSubtractorMOG2 module. here is a result on Oxford Town Center: photo_2020-05-17_02-07-53 photo_2020-05-17_02-07-57 Now I am trying to filter object detection's output based on this information. To doing this I will filter boxes that the percentage of background pixels more than a threshold.

alpha-carinae29 avatar May 16 '20 21:05 alpha-carinae29

Also I am implementing a prior distribution of bounding boxes for each pixel in the image. (only mean and variance not the whole distribution.) To this end I computed the average and variance of width and height of bounding boxes for the centroids of the boxes recurrently with Welford algorithm. After the training Phase, for each detected bounding box we compare its width and height with the prior mean and variance and if we detect an outlier we eliminate the bounding box.

alpha-carinae29 avatar May 16 '20 21:05 alpha-carinae29

@mhejrati please mark it as "in progress".

alpha-carinae29 avatar May 16 '20 21:05 alpha-carinae29