calibration icon indicating copy to clipboard operation
calibration copied to clipboard

Evaluating Calibration-There is no output/dev or output/test

Open Mahhos opened this issue 5 years ago • 0 comments

Hi. Thanks for the great repo. When fine-tuning bert on SNLI task using the commands in the Fine-tuning Models section, one file SNLI_bert-base-uncased.json is generated in the output folder. It seems that for the Evaluating Calibration there should be 2 folders output/dev or output/test. Should we put the generated SNLI_bert-base-uncased.json for both of them?

Mahhos avatar Feb 17 '21 16:02 Mahhos