supervised-reptile icon indicating copy to clipboard operation
supervised-reptile copied to clipboard

question about dataset

Open YuBeomGon opened this issue 4 years ago • 1 comments

In the paper, I found this sentence, Unlike FOMAML, Reptile doesn’t need a training-test split for each task, which may make it a more natural choice in certain settings (https://arxiv.org/pdf/1803.02999.pdf)

it means I dont need to split data?(support set and query set in each episode in train data set) Am I right?

YuBeomGon avatar Aug 11 '20 05:08 YuBeomGon

I think you are interpreting the sentence correctly. Basically, Reptile doesn't require you to split up each mini-dataset during meta-learning. It seems that FOMAML works mostly because there's a separate mini-test-set that has a useful gradient after the model has fully overfit to the mini-training-set.

unixpickle avatar Aug 12 '20 18:08 unixpickle