TSD icon indicating copy to clipboard operation
TSD copied to clipboard

Can TSD head be used on top of RetinaNet?

Open CodeJjang opened this issue 5 years ago • 5 comments

As I understood, the TSD fine tunes proposals from the RPNs existing in Faster RCNN, Mask RCNN, Cascada RCNN etc.
In RetinaNet we don't have region proposals but instead the head convolves the different levels of the FPN using anchors.
Theoretically, what if a certain spatial convolution location is good for the classification but a slightly offset one is better for regression, just like in the TSD case?
Wouldn't RetinaNet benefit from a TSD head as well?

CodeJjang avatar Jul 17 '20 22:07 CodeJjang

Hi, this is a very meaningful question. In fact, TSD does help alleviate the misalignment between classification and localization in RetinaNet. In our private experiments, we have improved the performance of some anchor-free detectors by a large margin with the assistance of TSD.

songguanglu avatar Aug 03 '20 13:08 songguanglu

@songguanglu Do you have somewhere the implementation of TSD on RetinaNet you've done, for reference?

CodeJjang avatar Aug 10 '20 14:08 CodeJjang

We have only performed the TSD variant on FCOS. If you are interested in the performance on RetinaNet, you can try to implement it based on this project. Any questions can be discussed here in time.

songguanglu avatar Aug 11 '20 05:08 songguanglu

@songguanglu Thanks for your wonderful works on feature disentagle. I have the same question that dose the TSD supports anchor-based single stage detector ? It's a great news that TSD can improves the performance of FCOS, did you add it after FPN and the separatly heads used to get classification head and regression head, respectively?

BlueCCircles avatar Nov 30 '20 08:11 BlueCCircles

您好,您是如何将TSD运用到FCOS中的呀,按照论文中提的,应该只能使用在two-stage中。

houlei123123 avatar Dec 09 '20 12:12 houlei123123