Medi-CoQA icon indicating copy to clipboard operation
Medi-CoQA copied to clipboard

Bad performance with trained models

Open sdvies opened this issue 1 year ago • 0 comments

Hi! I am trying to build a CoQA model by following the steps that appear in the non docker alternative readme. After downloading the datasets "training set" and "dev set" from CoQA datasets and having trained the model, I found that it does not work properly. Using clinicalbert model and asking the same that you use in chatbots' article, we obtain the following:

image

Do you know what I am doing wrong? Because I have seen that in chatbots' article it works perfectly.

Thank you very much!

sdvies avatar May 23 '23 11:05 sdvies