gnn_few_shot_cifar100 icon indicating copy to clipboard operation
gnn_few_shot_cifar100 copied to clipboard

class overlap between train and test data

Open sudarshan1994 opened this issue 5 years ago • 1 comments

I am not able to find out how class overlap between train and test data is being maintained. Typically in few shot learning evaluation, few classes are never shown to the model, and on test time we evaluate the model by giving it N examples from those classes that have not been shown to the model. I am not sure if this separation is maintained in the code.

sudarshan1994 avatar Apr 13 '19 19:04 sudarshan1994

Hi,

In this code, the few shot classes of testing data are same as which of validation data if the random seed is specified. Therefore, the separation is not maintained in the code. However, this is indeed an issue, and I will address it as soon as possible. Thank you pointing out this bug!

ylsung avatar Apr 16 '19 05:04 ylsung