deep-learning-containers icon indicating copy to clipboard operation
deep-learning-containers copied to clipboard

Performance issues in /test/dlc_tests/container_tests/bin (by P3)

Open DLPerf opened this issue 4 years ago • 1 comments

Hello! I've found a performance issue in /test/dlc_tests/container_tests/bin/fully_connected_reader.py: batch() should be called before map(), which could make your program more efficient. Here is the tensorflow document to support it.

Detailed description is listed below:

  • dataset = dataset.batch(batch_size)(line 127) should be called before dataset = dataset.map(decode)(line 116), dataset = dataset.map(augment)(line 117) and dataset = dataset.map(normalize)(line 118).

Besides, you need to check the function called in map()(e.g., normalize called in dataset = dataset.map(normalize)) whether to be affected or not to make the changed code work properly. For example, if normalize needs data with shape (x, y, z) as its input before fix, it would require data with shape (batch_size, x, y, z).

Looking forward to your reply. Btw, I am very glad to create a PR to fix it if you are too busy.

DLPerf avatar Aug 27 '21 12:08 DLPerf

Hello, I'm looking forward to your reply~

DLPerf avatar Nov 04 '21 09:11 DLPerf