TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

trtexec error, Error Code 3: Internal Error (SymbolAddress for getPluginCreators could not be loaded,

Open jjxyai opened this issue 1 year ago • 6 comments

Description

convert onnx to engine with trtexec:

trtexec --onnx=model.onnx --dynamicPlugins=plugin_lib.dll --saveEngine=model16.engine --fp16 --allowGPUFallback

with error output:

[E] [TRT] 3: [libLoader.cpp::nvinfer1::rt::DynamicLibrary::Impl::untypedSymbolAddress::365] Error Code 3: Internal Error (SymbolAddress for getPluginCreators could not be loaded, check function name against library symbol)

Environment

TensorRT Version:8.6

NVIDIA GPU:4060

NVIDIA Driver Version:546.92

CUDA Version:12.3

CUDNN Version:8.9

Operating System:win11

jjxyai avatar Aug 06 '24 03:08 jjxyai

Check your dll function api right, or use static plugin.
dumpbin /exports ./plugin_lib.dll

lix19937 avatar Aug 06 '24 14:08 lix19937

getCreators (previously known as getPluginCreators) has to be implemented in the plugin shared library if you want to use trtexec --dynamicPlugins.

leimao avatar Aug 06 '24 17:08 leimao

yes, this is documented in https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#generating-plugin-library, will close this, thanks all!

ttyio avatar Aug 07 '24 00:08 ttyio

https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#generating-plugin-library

No, it did not say it is a must for trtexec.

leimao avatar Aug 07 '24 00:08 leimao

https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#generating-plugin-library

No, it did not say it is a must for trtexec.

This is a must if you want your plugin work with the version compatibility feature. However, I reopen this created internal issue to track the document update for this.

ttyio avatar Aug 07 '24 00:08 ttyio

getCreators (previously known as getPluginCreators) has to be implemented in the plugin shared library if you want to use trtexec --dynamicPlugins.

solved by adding methods mentioned in 9.9.1. Generating Plugin Shared Libraries

thanks a lot!!

jjxyai avatar Aug 07 '24 01:08 jjxyai