sotabench-api icon indicating copy to clipboard operation
sotabench-api copied to clipboard

Make clear which subset - 'val' or 'test' (or other)

Open RJT1990 opened this issue 6 years ago • 0 comments

  • Need to say in the library if it's validation or test.
  • When doing PwC integration, need to also add new field specifying the dataset subset.

For example, I don't have Cityscapes test data, only validation data. But PWC evaluates on the test set, whereas the library will evaluate on the validation set.

RJT1990 avatar Jun 22 '19 19:06 RJT1990