ConvLab-2 icon indicating copy to clipboard operation
ConvLab-2 copied to clipboard

Published 20 hours ago • verified publisher icon thu-coai

得到的准确率与README文件中的相比差距较大

Open yixuan004 opened this issue 3 years ago • 1 comments

当我在/content/ConvLab-2/convlab2/dst目录下执行!python evaluate.py MultiWOZ TRADE test时，得到的准确率分别为：{'Joint Acc': 0.27075420510037984, 'Turn Acc': 0.9226351962379891, 'Joint F1': 0.7568646167948684} image

但在您的README文件中给出了更高的准确率，不知道是否是我哪里操作有误？ image

yixuan004 avatar Sep 14 '21 08:09 yixuan004

我们后来修改了 evaluate.py (https://github.com/thu-coai/ConvLab-2/pull/85/files) 但还没有更新结果。多谢反馈！

zqwerty avatar Sep 15 '21 02:09 zqwerty