Xianchao Wu

icon indicating a website link https://sites.google.com/site/xianchaowu2012/ icon indicating an email [email protected]

icon company NVIDIA Japan icon location Tokyo icon location chatbot, NLP, deep learning, statistical machine translation

Results 1 issues of Xianchao Wu

bug in computing scores for longdialogue_qa_eng

1 comment

https://github.com/OpenBMB/InfiniteBench/blob/main/src/compute_scores.py#L238 1. only one reference label is used for comparison, better loop around each answer in label, e.g., label=['ECKER', 'COMMANDER BILL ECKER']; 2. prediction phrase is splitted into words for...