edflow icon indicating copy to clipboard operation
edflow copied to clipboard

Benchmark data-loading

Open theRealSuperMario opened this issue 5 years ago • 0 comments

It might be good to have an easy way to see if the data loading is a bottleneck of the GPU is a bottleneck.

In a second stage, it might be useful to be able to automatically generate a binary file, such as tfrecords, from a specified config file and then load the data from the tf records.

That allows the user to be able to work normally and if the data I/O is the bottleneck, it is automatically binarized to improve performance.

theRealSuperMario avatar Feb 05 '20 14:02 theRealSuperMario