mmocr icon indicating copy to clipboard operation
mmocr copied to clipboard

WIP:[Feature] add a new pipeline for text recognition

Open Harold-lkk opened this issue 3 years ago • 2 comments

Motivation

In the latest paper and text recognition, TR tend to be using more information for recognition, like position information in RobustScanner, language information in ABINet and VisionLAN , Semantic Reasoning in SRN. Essentially, all the ideas are multimodal fusion. Therefore, implement a new pipeline for multimodal fusion

Harold-lkk avatar Dec 08 '21 09:12 Harold-lkk

Codecov Report

Merging #653 (83c59f7) into main (abfe75d) will decrease coverage by 1.23%. The diff coverage is 66.85%.

:exclamation: Current head 83c59f7 differs from pull request most recent head 6ae0adb. Consider uploading reports for the commit 6ae0adb to get more accurate results Impacted file tree graph

@@            Coverage Diff             @@
##             main     #653      +/-   ##
==========================================
- Coverage   85.69%   84.45%   -1.24%     
==========================================
  Files         142      146       +4     
  Lines        9539     9953     +414     
  Branches     1364     1504     +140     
==========================================
+ Hits         8174     8406     +232     
- Misses       1048     1219     +171     
- Partials      317      328      +11     
Flag Coverage Δ
unittests 84.45% <66.85%> (-1.24%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
mmocr/core/deployment/deploy_utils.py 23.03% <0.00%> (-0.58%) :arrow_down:
mmocr/core/evaluation/hmean.py 91.35% <0.00%> (-2.32%) :arrow_down:
mmocr/core/evaluation/hmean_ic13.py 95.28% <ø> (ø)
mmocr/core/evaluation/hmean_iou.py 94.73% <ø> (ø)
mmocr/core/evaluation/ner_metric.py 100.00% <ø> (ø)
mmocr/core/evaluation/utils.py 88.98% <ø> (ø)
mmocr/datasets/pipelines/ocr_seg_targets.py 76.34% <ø> (ø)
...atasets/pipelines/textdet_targets/dbnet_targets.py 91.74% <ø> (ø)
mmocr/models/textdet/dense_heads/db_head.py 100.00% <ø> (ø)
mmocr/models/textdet/dense_heads/drrg_head.py 97.91% <ø> (ø)
... and 52 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update abfe75d...6ae0adb. Read the comment docs.

codecov[bot] avatar Dec 08 '21 09:12 codecov[bot]

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

:white_check_mark: Harold-lkk
:x: liukuikun


liukuikun seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Oct 30 '22 14:10 CLAassistant