UBAR-MultiWOZ icon indicating copy to clipboard operation
UBAR-MultiWOZ copied to clipboard

Published 20 hours ago • verified publisher icon TonyNemo

How to reproduce the results on multiwoz2.0 reported in your paper using the provided checkpoint?

Open lizekang opened this issue 4 years ago • 6 comments

I downloaded the provided checkpoint and tested it. But I couldn't reproduce the results on multiwoz2.0 reported in your paper.

inform success bleu score
96.3 91.1 22.26 115.96

lizekang avatar Dec 24 '20 07:12 lizekang

By reading the Readme file and following the steps.

TonyNemo avatar Dec 24 '20 10:12 TonyNemo

I follow the steps in the readme file but just get the results above using your checkpoint.

lizekang avatar Dec 24 '20 12:12 lizekang

Has this problem been solved? I evaluated using the response generation setting and got the same results above: validation [CTR] match: 96.30 success: 91.10 bleu: 22.26 score: 115.96

Red-Liu199 avatar Feb 25 '21 07:02 Red-Liu199

I have double-checked on my end.

TonyNemo avatar Feb 25 '21 10:02 TonyNemo

I downloaded the provided checkpoint and tested it. But I couldn't reproduce the results on multiwoz2.0 reported in your paper.

inform success bleu score 96.3 91.1 22.26 115.96

same result!

311dada avatar Apr 25 '21 07:04 311dada

@TonyNemo

SkyAndCloud avatar Aug 25 '21 09:08 SkyAndCloud