multiwoz

multiwoz copied to clipboard

Hi, I'm wondering what tools to use for visualizing JSON. Do you use a NoSQL database to create the data and then export it? Or do you simply use some...

BiEchi

How to get the ontology.json for MultiWOZ 2.2?

1

Hi, may I ask how to get the "ontology.json" for MultiWOZ 2.2 like 2.0 and 2.1? Since the slots are not exactly same as those in 2.0 and 2.1, I...

Young973

Why is the slot value train-arriveby not updated?

2

Hi.When I use the test_dials to test my dst model.I found that some slot-values about train-arriveby are not update in the ground truth. Such as MUL2294 : "transcript": "i need...

westofsun

Does the preprocessing script work for 2.2?

1

There is no instruction in README on how to run preprocessing for 2.2. Instead, it implies that delexicalization is only compatible with earlier versions. Can someone confirm if that's the...

GeekAlexis

invalid and pre_invalid

1

What do these two fields mean in book domain in MultiWOZ 2.0?

xiami2019

What does `pre_invalid` mean in the `book` field?

3

Hi, what does `pre_invalid` mean in the `book` field? How is it relate to `invalid`? Thanks!

failable

https://github.com/budzianowski/multiwoz/blob/42a1ff2cb75f113a09c4e014dce7e00e3e589149/create_delex_data.py#L335 Each act in dialogue_acts.json is the response corresponding to the system, and the number of acts in each dialogue is equal to the number of responses in each dialogue....

MseXing

The upper bound of Inform and Success rate?

5

I run evaluate.py and get Matches(inform): 90.40, Success 82.3. Are these the upper bound of metric Inform and Success? In some paper, the inform and success rate can exceed 90.40,82.3....

yunhaoli1995

I have started to collect a new dataset for a new domain, but I don't know how to **annotate** the dataset. Should I annotate them **manually**? Or is there a...

En-J-A

Normalization during test

2

Hi. https://github.com/budzianowski/multiwoz/blob/a24d299fafa00371d03880bce34cb3b0923518fa/evaluate.py#L133 https://github.com/budzianowski/multiwoz/blob/a24d299fafa00371d03880bce34cb3b0923518fa/utils/nlp.py#L73 In this line, the values of belief state are normalized before searching DB. But, the time values of train(leaveAt, arrvieBy) are also normalized to [value_time]. In this...

gusalsdmlwlq