Rewriting `DataSampler` to pytorch `DataLoader` object

Open Baukebrenninkmeijer opened this issue 5 years ago • 2 comments

If the datasampler can be rewritten to a normal pytorch dataloader, we can more easily integrate it with other deep learning frameworks like PyTorch Lightning and Horovod. Both facilitate multi-gpu training and distributed training, which can be super advantageous for larger (/corporate) domains.

Dec 03 '20 12:12 Baukebrenninkmeijer

This is a good idea but I believe it may take a significant amount of effort to actually implement it. I will shelve it for now, since there are other higher priority tasks, but I agree we should take a look at adding this feature in the future.

Mar 05 '21 01:03 fealho

@fealho can you label it as such? Or shall I close in the meantime?

Mar 10 '21 15:03 Baukebrenninkmeijer