ffcv
ffcv copied to clipboard
The loading process is unusually slow
I have modified the two parameters as described in the documentation(https://docs.ffcv.io/parameter_tuning.html#scenario-large-scale-datasets). However, when I load data from “.beton” it takes a lot of time, so far it has been loaded for 6hours, but the loading process has not been completed.
Ps: The .beton file is about 320GB, with a total of about 130K images.