Xiaodong (Vincent) Huang
Xiaodong (Vincent) Huang
Hi @geraldstanje , could you post the question in https://github.com/triton-inference-server/server, we have triton experts there, thanks!
yes, this is documented in https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#generating-plugin-library, will close this, thanks all!
> > https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#generating-plugin-library > > No, it did not say it is a must for trtexec. This is a must if you want your plugin work with the version compatibility...
Closing since no activity for more than 3 weeks, pls reopen if you still have question, thanks!
@braindotai please try with latest release and share with @zerollzeng the repro if still failed, thanks!
@yuanjiechen could you upgrade your trt version to latest 10.x and retry? thanks!
> @ttyio Thanks for your reply! The nearest trt version on jetson orin which I can find is 8.6.x? yes, let's see if 8.6 helps here. thanks!
@JoAnn0812 where did you download the checkpoint? If you use are using custom checkpoint instead of the official one in this repo README, you need change the weights mapping function...
closing since there is already WAR, thanks all!
closing since no activity for more than 3 weeks, pls reopen if you still have question, thanks all!