cloud icon indicating copy to clipboard operation
cloud copied to clipboard

Performance issues in /src/python/tensorflow_cloud/core (by P3)

Open DLPerf opened this issue 3 years ago • 4 comments

Hello! I've found a performance issue in /tests/testdata/keras_tuner_cifar_example.py: batch() should be called before map(), which could make your program more efficient. Here is the tensorflow document to support it.

Detailed description is listed below:

  • .batch(BATCH_SIZE)(here) should be called before train_dataset.map(scale)(here).
  • .batch(BATCH_SIZE)(here) should be called before .map(scale)(here).

Besides, you need to check the function called in map()(e.g., scale called in .map(scale)) whether to be affected or not to make the changed code work properly. For example, if scale needs data with shape (x, y, z) as its input before fix, it would require data with shape (batch_size, x, y, z).

Looking forward to your reply. Btw, I am very glad to create a PR to fix it if you are too busy.

DLPerf avatar Aug 29 '21 13:08 DLPerf

Hello, I'm looking forward to your reply~

DLPerf avatar Nov 04 '21 09:11 DLPerf

I would like to contribute in solving this issue. Can you please assign this issue to me? @DLPerf @lamberta @mihaimaruseac @jaeyounkim @martinwicke

sharmadhiraj86 avatar Sep 11 '22 07:09 sharmadhiraj86

We don't generally assign issue to contributors. Instead, please send a PR when ready.

mihaimaruseac avatar Sep 12 '22 17:09 mihaimaruseac