mmdetection icon indicating copy to clipboard operation
mmdetection copied to clipboard

[Feature] Support OC Cost metric

Open okotaku opened this issue 1 year ago • 4 comments

Motivation

github: https://github.com/mayu-ot/oc-cost paper: https://arxiv.org/abs/2203.14438

Use cases (Optional)

val_evaluator = dict(
    type="CocoOCCostMetric",
    alpha=0.5,
    beta=0.6,
    ann_file=ann_file,
    metric="bbox",
)

Checklist

  1. Pre-commit or other linting tools are used to fix the potential lint issues.
  2. The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
  3. If the modification has potential influence on downstream projects, this PR should be tested with downstream projects, like MMDet or MMPreTrain.
  4. The documentation has been modified accordingly, like docstring or example tutorials.

okotaku avatar Oct 27 '23 08:10 okotaku

@okotaku Thank you. You can create a folder named "mmdetection/configs/occost" and provide evaluation configurations for several classical algorithms(faster rcnn/retinanet/tood/dino) in it. Additionally, you can also provide a configuration for joint evaluation with COCO mAP. Afterwards, you can include the specific metrics in the README for future reference.

hhaAndroid avatar Nov 06 '23 09:11 hhaAndroid

@hhaAndroid This PR is ready!

okotaku avatar Nov 27 '23 04:11 okotaku

@okotaku I'm sorry for the delayed response. Now that there is a conflict, please synchronize and update me. Thank you.

hhaAndroid avatar Dec 22 '23 10:12 hhaAndroid

@hhaAndroid This PR is ready.

okotaku avatar Jan 20 '24 15:01 okotaku