dataloader-benchmarks

dataloader-benchmarks copied to clipboard

@kiedanski I want to run the benchmark locally, how to I obtain the value to set to `WHEEL_PASSWORD` environment variable? As the following is mentioned in the [paper](https://arxiv.org/pdf/2209.13705.pdf), I expected...

Tudyx

Hi, I'm one of the maintainers of TorchData and I would like to note that TorchData does support remote data loading, especially from Amazon S3. You can use the [`S3FileLoader`](https://pytorch.org/data/main/generated/torchdata.datapipes.iter.S3FileLoader.html)...

NivekT

Thanks for sharing your work! Does the integration of [NVIDIA DALI](https://github.com/NVIDIA/DALI/tree/a4f7d591ffc6f96eec56c83b33074d7205c2e7f0/dali/operators/reader) to this benchmark is planned for the future?

Tudyx