Question: trtexec hardware during compilation vs production?

[NikeNano]

I am using tensorRT together with Triton. Inorder to avoid a long runing start up time when we deploy to edge nodes I would like to do the tensorRT conversion before we deploy(Triton have support for doing it from different model formats) using the cli: trtexec. Do I need to do the trtexet step on exactly the same hardware (GPU, CPU)?

Thank you!

[zerollzeng]

You need to build the engine in the same GPU.

[ttyio]

closing since no activity for more than 3 weeks, please reopen if you still have question, thanks!