online-continual-learning icon indicating copy to clipboard operation
online-continual-learning copied to clipboard

Training ImageNet-1K

Open nlrahimi opened this issue 2 years ago • 0 comments

Hi, Thanks for the amazing work. I enjoyed reading your paper. Running experiments I wanted to train ImageNet-1k using some baseline methods you have kindly shared the implementation for. However, I noticed ImageNet-100 is loaded in a pickle file, unlike frameworks that use dataloader for imagenet to load batches in a few phases. The problem is that when it comes to ImageNet1k its not possible to load all data at once. My question is how can I use dataloaders in Mini_ImageNet class in continuum/dataset_scripts structure, in a way that it does not disrupt other functions in relevant codes?

` class Mini_ImageNet(DatasetBase):

 def __init__(self, scenario, params): 

 def download_load(self):

 def new_task(self, cur_task, **kwargs):

        elif self.scenario == 'nc':

            labels = self.task_labels[cur_task]

            x_train, y_train = load_task_with_labels(self.train_data, self.train_label, labels)

        return x_train, y_train, labels

`

nlrahimi avatar Feb 03 '23 21:02 nlrahimi