ffcv icon indicating copy to clipboard operation
ffcv copied to clipboard

The loading process is unusually slow

Open yajieC opened this issue 2 years ago • 0 comments

I have modified the two parameters as described in the documentation(https://docs.ffcv.io/parameter_tuning.html#scenario-large-scale-datasets). However, when I load data from “.beton” it takes a lot of time, so far it has been loaded for 6hours, but the loading process has not been completed.

Ps: The .beton file is about 320GB, with a total of about 130K images.

yajieC avatar Sep 05 '22 12:09 yajieC