dataloader-benchmarks icon indicating copy to clipboard operation
dataloader-benchmarks copied to clipboard

Published 20 hours ago • verified publisher icon smartnets

Support for 'remote' in TorchData

Open NivekT opened this issue 2 years ago • 0 comments

Hi,

I'm one of the maintainers of TorchData and I would like to note that TorchData does support remote data loading, especially from Amazon S3. You can use the S3FileLoader and you can find more examples with fsspec here.

Thanks for your interest in our library! Feel free to reach out if there is any question about it.

cc: @ejguan

NivekT avatar Jan 05 '23 21:01 NivekT