lightning-flash icon indicating copy to clipboard operation
lightning-flash copied to clipboard

New heads and backbones for object detection 🤔

Open Nexer8 opened this issue 3 years ago • 3 comments

🚀 Feature

Please consider porting more heads and backbones for object detection task.

Motivation

The number of heads and backbones for the task of object detection remains rather low in comparison to MMDetection.

Pitch

Introduce compatibility with new heads and backbones for object detection.

Alternatives

Additional context

Also, are there any plans to introduce solutions using transformer architecture, such as Swin Transformer, into this project, or is lightning-transformers meant particularly for this?

Discussed in https://github.com/PyTorchLightning/lightning-flash/discussions/1355.

Nexer8 avatar Jun 12 '22 00:06 Nexer8

Hey @Nexer8 thanks for the feature request! More heads / backbones (including transformers) is definitely something we'd like to have. We tried to source backbones from MMdetection once before but found it to be too heavy a dependency for our testing , but this is something we should revisit :smiley:

ethanwharris avatar Jun 29 '22 12:06 ethanwharris

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Sep 22 '22 04:09 stale[bot]

any plans to add new heads and backbones for object detection? it seems that icevision is not maintained anymore. mmdetection 3.0 has been released with the DINO model which has great performance on the COCO2017 dataset.

https://github.com/open-mmlab/mmdetection/tree/main/configs/dino

davidblom603 avatar May 18 '23 06:05 davidblom603

@davidblom603 are you interested in sending a PR? :rabbit:

Borda avatar Jun 16 '23 11:06 Borda