dress icon indicating copy to clipboard operation
dress copied to clipboard

What's difference with SARI and STAR?

Open Sanqiang opened this issue 7 years ago • 1 comments

For your evaluation, I thought you use evaluation code from Joshua. They have both SARI and STAR, could I ask is there any special reason you use STAR rather than STAR?

Sanqiang avatar Feb 11 '18 07:02 Sanqiang

SARI in Joshua is on sentence-level, which may bias to shorter sentences (the same issue as in sentence-level bleu).

On 11 February 2018 at 15:26, Sanqiang Zhao [email protected] wrote:

For your evaluation, I thought you use evaluation code from Joshua. They have both SARI and STAR, could I ask is there any special reason you use STAR rather than STAR?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/XingxingZhang/dress/issues/9, or mute the thread https://github.com/notifications/unsubscribe-auth/AIHQwaw2u1roaj8vL3rV3c7hoVc380Bjks5tTpYogaJpZM4SBPZw .

-- Xingxing Zhang

Institute for Language, Cognition and Computation (ILCC) The University of Edinburgh

XingxingZhang avatar Feb 11 '18 07:02 XingxingZhang