DeepForest icon indicating copy to clipboard operation
DeepForest copied to clipboard

Multi-scale cropping based on density maps.

Open bw4sz opened this issue 2 years ago • 8 comments

https://openaccess.thecvf.com/content_CVPRW_2020/papers/w11/Li_Density_Map_Guided_Object_Detection_in_Aerial_Images_CVPRW_2020_paper.pdf

image

We often have multi-scale challenges, especially as predict_tile just cuts images into uniform pieces. This an interesting idea for bird detection. with trees the images are often uniformly trees.

bw4sz avatar Mar 08 '24 16:03 bw4sz

Sparse RCNN

https://github.com/PeizeSun/SparseR-CNN worth exploring as well.

bw4sz avatar Mar 08 '24 17:03 bw4sz

Hi @bw4sz, can I work on this issue?

Om-Doiphode avatar Mar 08 '24 17:03 Om-Doiphode

@Om-Doiphode, Feel free to address any unresolved issues without needing explicit permission. If an issue remains unassigned, you are welcome to take initiative and work on it.

henrykironde avatar Mar 08 '24 17:03 henrykironde

I have read the research paper on Density Map Guided Object Detection in Aerial Images. Should I include the code for DMNet under deepforest/models folder?

Om-Doiphode avatar Mar 09 '24 15:03 Om-Doiphode

This seems like a pretty complex topic that is unlikely to be easily added on a short time-frame, but could make a decent GSOC proposal. This would implement dynamic cropping, which would influence the behavior of predict_tile rather than replacing the detection model (though I'm not super clear on the double use of the detector yet).

@bw4sz - I'm assuming you were thinking about this as a more complex feature request project rather than a smaller issue. Is that right?

ethanwhite avatar Mar 18 '24 18:03 ethanwhite

yes, anything with the machine learning label is going to be a pretty big lift.

bw4sz avatar Mar 18 '24 23:03 bw4sz

Thanks @bw4sz.

So, @Om-Doiphode - it's great that you're excited about this one, but we think it's better to think of it as a GSOC project to propose (if you want; there are certainly other good options) not an initial contribution. We've done some issue cleanup and labeled a bunch of additional issues as good first issue which will be a little more manageable to engage with as you're getting familiar with the code base.

ethanwhite avatar Mar 19 '24 12:03 ethanwhite

Thank you @ethanwhite

Om-Doiphode avatar Mar 19 '24 14:03 Om-Doiphode