Med-AL-SSL icon indicating copy to clipboard operation
Med-AL-SSL copied to clipboard

Published 20 hours ago • verified publisher icon marrlab

Data Loader speeding up methods

Open cliangyu opened this issue 3 years ago • 0 comments

I have sufficient memory while not many CPU cores on my server, therefore IO can be the bottleneck of the training trials.

I noticed that you have set pin_memory=False in PyTorch DataLoader, and I didn't see any change of run time from toggling it.

Since this experiment is quite IO heavy, have you tried any speeding up method?

cliangyu avatar Aug 12 '21 06:08 cliangyu