tflite-tools
tflite-tools copied to clipboard
Simulation or profiling?
Hi,
It is great work! I just wonder if the memory usage you calculated is based on simulation (calculate the tensor size and memory consumption) or profiling (poking the memory used by tflite interpreter code)?
Thank you!
Hey,
It's inspecting the graph of the model, so I guess it's neither.
Since it only makes a judgement about the model, this wouldn't pick up framework specific overheads, like storing tensor metadata, lost memory due to fragmentation, op-specific temporary "scratch" buffers, etc. that you would see in profiling.
On Thu, 17 Sep 2020, 23:02 Haoyu Wu, [email protected] wrote:
Hi,
It is great work! I just wonder if the memory usage you calculated is based on simulation (calculate the tensor size and memory consumption) or profiling (poking the memory used by tflite interpreter code)?
Thank you!
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/eliberis/tflite-tools/issues/4, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA23RHLUIE45BNZKU3MLT3LSGKBOBANCNFSM4RRCECZQ .