Anurag Dixit

I think the root cause for this failure is here: https://github.com/pytorch/TensorRT/blob/release/ngc/22.08/py/torch_tensorrt/_compile.py#L8-L10 @jaybdub: Please uncomment these lines and re-install. You should be able to run it correctly. I see that this...

@ghazalehtrb: Please refer to perf benchmark utility suite here: https://github.com/pytorch/TensorRT/tree/master/tools/perf

Did you change the rule in WORKSPACE file to use the distdir? Please refer to the [README](https://github.com/pytorch/TensorRT#2-building-using-locally-installed-cudnn--tensorrt)

Hi, Please refer the PyTorch release page for NGC here: https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/index.html I am also curious as the error logs shows: /usr/local/lib/python3.8/dist-packages/torch_tensorrt/lib/libtorchtrt.so Inside the NGC container the path for torch_tensorrt package...

@Biaocsu: Which branch are you using? Please use release/ngc/22.01 branch if you want to build the source inside the NGC container.

Hi @chophilip21 @Biaocsu, It seems the error is related to this API change updated here in NGC 22.02 release. https://github.com/NVIDIA/Torch-TensorRT/commit/449723ef014fc839cbed5fda0824419a902bd403# However, I am able to build release/ngc/22.01 branch with BASE=22.01....

Hi @void-main, I tried your script ( https://github.com/pytorch/TensorRT/issues/830#issuecomment-1032374613) on master branch and observed following logs: `before compile use 7.4726243019104 ms each inference 133.82179534227978 step/s after compile use 2.0044188499450684 ms each...

I need to check.

@centerzong: Can you please try the master branch and confirm if it fixes your issue?

@noman-anjum-retro: Don't you need to load torchtrt_runtime.dll using python on windows?