ExplainaBoard icon indicating copy to clipboard operation
ExplainaBoard copied to clipboard

Inconsistent number of test samples between test data and system predictions in KG task

Open pfliu-nlp opened this issue 2 years ago • 0 comments

the number of test samples in https://github.com/PhaelIshall/KGExplainaBoard/tree/main/FB15K-237 is: 20466 while the number of test samples in https://github.com/PhaelIshall/KGExplainaBoard/tree/main/user-defined-ranks is: 20441, such inconsistency results in some errors when we introduce training set dependent features

I will generate a dummy version of the test data and put it in DataLab SDK, so that it will not affect my further implementation, but the test data should be updated later.

pfliu-nlp avatar May 04 '22 21:05 pfliu-nlp