TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

Given an engine file, how to know what GPU model it is generated on?

Open yangdong02 opened this issue 1 year ago • 8 comments

When I use trtexec and I mix TensorRT engine plan files across different GPU models, I can get a warning:

Using an engine plan file across different models of devices is not recommended and is likely to affect performance or even cause errors

I would also like to do this check in my own program, but I cannot find an API to get what GPU model an engine file is generated on. For a similar question, "what TensorRT version is an engine file generated on", I find that I can know the answer using https://github.com/NVIDIA/TensorRT/issues/3073#issuecomment-1599934548. I'm wondering if there is any similar trick for GPU model information. Thanks a lot!

yangdong02 avatar Nov 01 '24 06:11 yangdong02