TextBoxes_plusplus_Tensorflow icon indicating copy to clipboard operation
TextBoxes_plusplus_Tensorflow copied to clipboard

测试精度问题

Open wangyuxin87 opened this issue 5 years ago • 9 comments

作者你好 我想问下这个tensorflow版本能达到原文精度吗? 略次还是略高?

wangyuxin87 avatar Mar 19 '19 09:03 wangyuxin87

期待你的回复!

wangyuxin87 avatar Mar 19 '19 09:03 wangyuxin87

I use the released ckpt in this git, test on the ICDAR Incidental 2015 test set. The result seems not good enough. Recall/Precision/Hmean: 0.666/0.035/0.067 Using prob score, under the best hmean, p/r/f1-score: 0.453/0.406/0.428 I assume the author didn't train on this training set, so next i'll try and show the results.

basaltzhang avatar Mar 27 '19 02:03 basaltzhang

I use the released ckpt in this git, test on the ICDAR Incidental 2015 test set. The result seems not good enough. Recall/Precision/Hmean: 0.666/0.035/0.067 Using prob score, under the best hmean, p/r/f1-score: 0.453/0.406/0.428 I assume the author didn't train on this training set, so next i'll try and show the results.

The released model was trained on SynthText Dataset.You can train your own model base on it.

Shun14 avatar Mar 27 '19 03:03 Shun14

期待你的回复!

大概低一点,因为有些论文里提到的trick我没加,比如数据增强的时候,对小物体的crop的时候的规则

Shun14 avatar Mar 27 '19 03:03 Shun14

好的 谢谢!

wangyuxin87 avatar Mar 27 '19 03:03 wangyuxin87

The author says N in loss function is the number of default boxes that match groundtruth boxes, but in this code is the batch size instead.

basaltzhang avatar Mar 29 '19 09:03 basaltzhang

Follow the author's training parameters in Table, I have the following result: p/r/f1-score: 0.773/0.697/0.733

basaltzhang avatar Apr 04 '19 03:04 basaltzhang

Follow the author's training parameters in Table, I have the following result: p/r/f1-score: 0.773/0.697/0.733

Could you tell me How you get this result, have you modified the loss function or other ways.The loss value does not decreas when training on icdar2015.

qingfengyy avatar Jun 11 '19 05:06 qingfengyy

Follow the author's training parameters in Table, I have the following result: p/r/f1-score: 0.773/0.697/0.733

Could you tell me How you get this result, have you modified the loss function or other ways.The loss value does not decreas when training on icdar2015.

I have the some problem when i use the released model which pre-trained on Synthtext, the loss seem ridiculous and wave between 70 to 200 (sometime even higher). Have you guys solved this problem?

jercas avatar Jul 15 '19 08:07 jercas