ConvLab-3 icon indicating copy to clipboard operation
ConvLab-3 copied to clipboard

Policy for sgd dataset [BUG]

Open AtheerAlgherairy opened this issue 3 years ago • 2 comments

I was trying to build build the complete agent pipeline on Schema-guided (sgd) dataset but I got the following error:

Screen Shot 1444-05-13 at 12 30 14 AM Screen Shot 1444-05-13 at 12 30 26 AM

AtheerAlgherairy avatar Dec 07 '22 07:12 AtheerAlgherairy

@ChrisGeishauser please take a look

zqwerty avatar Dec 07 '22 09:12 zqwerty

Hi!

Thanks for your issue and sorry for my late response, usually i respond quicker :)

You do load the multiwoz21 dataset in the vectorizer and vtrace class, so your action space is the action space of multiwoz21 (size of 208). Now in self.state[domain][slot], the domain is from a multiwoz action, so for instance "restaurant", but the state is from sgd where the domain is for instance "restaurant_1", which leads to the key error. At least that is what i suspect from the message.

To solve the problem, simply change the value for the key "dataset_name" in vtrace_DPT/config.json to "sgd". Moreover, in vtrace_DPT/semantic_level_config.json under "vectorizer_sys", also change the value to the key "dataset_name" to "sgd".

You should then see in the logs: Dimension of system actions: 684 Dimension of user actions: 584 State dimension: 1634

I will push some code later so that you only have to change the dataset name in the vectorizer to make it more robust and i will also update the readme to make it more clear :) Thanks a lot for your issue!

Let me know if it still does not work :)

Chris

ChrisGeishauser avatar Dec 12 '22 10:12 ChrisGeishauser