BertBasedCorrectionModels icon indicating copy to clipboard operation
BertBasedCorrectionModels copied to clipboard

评测脚本问题

Open FrankWork opened this issue 1 year ago • 0 comments

用你的配置训练的bert纠错模型,用你的评测脚本:

Sentence Level: 
acc:0.793636, precision:0.828810, recall:0.732472, f1:0.777669

使用realise模型的评测脚本:

{'sent-detect-acc': 82.18181818181817, 
'sent-detect-p': 72.86689419795222, 
'sent-detect-r': 78.9279112754159, 
'sent-detect-f1': 75.77639751552793, 
'sent-correct-acc': 79.9090909090909, 
'sent-correct-p': 68.60068259385666, 
'sent-correct-r': 74.3068391866913, 
'sent-correct-f1': 71.33984028393967}

你只在src == tgt时统计了FP,统计出的FP偏小,导致计算precision时的分母偏小,最终的precision偏大

FrankWork avatar Jul 29 '22 08:07 FrankWork