MultiWOZ2.4

MultiWOZ2.4 copied to clipboard

Has the system_acts.json file been renamed?

1

Hello. Thanks for your awesome work. However, I have one problem, I can't find the **system_acts.json** . Did the **system_acts.json** file get renamed to **dialog_acts.json** by any chance? I'm opening...

SediKOR

`dontcare` values

1

Hi, When the slot value is `dontcare`, should we expect a model to predict `dontcare`, or should we assume that any model prediction is ok? E.g. is it ok for...

Guppy16

Pipe ("|") separated slot values

2

Hi there, I am using this version of the dataset and I have noticed that for 436 dialogue turns there are slot values that are separated by a pipe ("|")....

pietrolesci

Add benchmark results from new work on leaderboard?

1

First, thanks for the nice work! There are some new papers on your dataset that are reporting new results. Can we update your benchmark leaderboard by pull requests? (just like...

Yushi-Hu

E2E Modeling

1

Hi, nice work! Would this refinement of belief states affects the performance on E2E modeling? In particularly, inform rate and success rate.

xiami2019

Thanks for your meaningful work! 👍🏻 There are a few questions I would like to ask about the performance recorded in the paper. 1. When the existing model trained MW2.4,...

yukyunglee

Could you please provide the results of STAR on MultiWOZ 2.4?

2

Thanks for your very good work and it is helpful. But the result of my rerunning the STAR on MultiWOZ 2.4 is 72.39% which is lower than reported in the...

narukamiko

which results of CHAN-DST should we use?

2

I notice that CHAN-DST and STAR are both in your git repo, and in paper of STAR you rerun the CHAN and report its joint goal as 53.38% at multi-woz2.1,...

fpcsong

preprocessing details?

2

Thank you for this effort! What do create_data.py and split.py do exactly? Why are they interchangeable?

tomyoung903