tflite-tools icon indicating copy to clipboard operation
tflite-tools copied to clipboard

Simulation or profiling?

Open wuhy08 opened this issue 4 years ago • 1 comments

Hi,

It is great work! I just wonder if the memory usage you calculated is based on simulation (calculate the tensor size and memory consumption) or profiling (poking the memory used by tflite interpreter code)?

Thank you!

wuhy08 avatar Sep 17 '20 22:09 wuhy08

Hey,

It's inspecting the graph of the model, so I guess it's neither.

Since it only makes a judgement about the model, this wouldn't pick up framework specific overheads, like storing tensor metadata, lost memory due to fragmentation, op-specific temporary "scratch" buffers, etc. that you would see in profiling.

On Thu, 17 Sep 2020, 23:02 Haoyu Wu, [email protected] wrote:

Hi,

It is great work! I just wonder if the memory usage you calculated is based on simulation (calculate the tensor size and memory consumption) or profiling (poking the memory used by tflite interpreter code)?

Thank you!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/eliberis/tflite-tools/issues/4, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA23RHLUIE45BNZKU3MLT3LSGKBOBANCNFSM4RRCECZQ .

eliberis avatar Sep 18 '20 08:09 eliberis