Qi Zhu

We did not evaluate the rule DST solely since it needs dialog acts as input. If you want to compare rule DST with other DST models, you may use the...

You can refer to the [Colab](https://colab.research.google.com/github/thu-coai/ConvLab-2/blob/master/tutorials/Getting_Started.ipynb) tutorial or the interface class for [nlu](https://github.com/thu-coai/ConvLab-2/blob/master/convlab2/nlu/nlu.py#L5) and [dst](https://github.com/thu-coai/ConvLab-2/blob/master/convlab2/dst/dst.py#L8). You can see [PipelineAgent](https://github.com/thu-coai/ConvLab-2/blob/master/convlab2/dialog_agent/agent.py#L40) for how to build an agent with modules. Example usage: https://github.com/thu-coai/ConvLab-2/blob/master/tests/test_BERTNLU-RuleDST-RulePolicy-TemplateNLG.py

Sure. Just feed the output of NLU to DST: https://github.com/thu-coai/ConvLab-2/blob/ad32b76022fa29cbc2f24cbefbb855b60492985e/convlab2/dialog_agent/agent.py#L122-L132

Sorry, I thought you need instruction about how to pass the output of NLU to DST. If you want to evaluate NLU+DST, you can write a script to: 1) read...

refer to https://github.com/thu-coai/ConvLab-2/blob/master/convlab2/dst/evaluate.py for dst metric

你是用这个https://github.com/thu-coai/ConvLab-2/blob/master/convlab2/policy/rule/crosswoz/rule_simulator.py 作为system policy吗？crosswoz相关代码的使用可以参考原仓库https://github.com/thu-coai/CrossWOZ

Yes, we will add it in the future

Could you try to create a new conda environment and install ConvLab-2 again? We don't have a constraint on the version of boto3 & botocore. In the [Colab](https://colab.research.google.com/github/thu-coai/ConvLab-2/blob/master/tutorials/Getting_Started.ipynb), I can...

maybe update the pip will solve the problem, too

Currently, we got a similar result. Still working on this.