dlio_benchmark icon indicating copy to clipboard operation
dlio_benchmark copied to clipboard

Published 20 hours ago • verified publisher icon argonne-lcf

Adding S3 support when PyTorch framework is selected.

Open zhenghh04 opened this issue 1 year ago • 7 comments

Check whether we can adopt the PyTorch S3 support: https://pytorch.org/data/main/generated/torchdata.datapipes.iter.S3FileLoader.html

zhenghh04 avatar Jan 12 '24 16:01 zhenghh04