LMC-Memory icon indicating copy to clipboard operation
LMC-Memory copied to clipboard

Shuffle dataloader with validation set

Open Scienceseb opened this issue 2 years ago • 1 comments

Hi !

I just want to point something kind of special, so it seems that your code even if I specified shuffle=True, don't make the valid dataloader shuffle.

So the shuffle=True is inactive:

 valid_dataset = Corem(args.valid_data_dir, seq_len=args.short_len+args.out_len, train=False)
 validataloader = DataLoader(valid_dataset, batch_size=args.batch_size, shuffle=True, num_workers=args.workers, drop_last=False)

Thanks for your help, for some reasons I need a validation dataloader shuffle.

Scienceseb avatar Nov 10 '21 21:11 Scienceseb

shuffle=True also can work with validloader. I just have confirmed that the data indexes are shuffled in case of shuffle=True.

Thanks

sangmin-git avatar Dec 07 '21 07:12 sangmin-git