TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

🐛 [Bug] Nightly import fails

Open laikhtewari opened this issue 9 months ago • 2 comments

Bug Description

Installed nightly and got OSError: libnvinfer_plugin.so.10: cannot open shared object file: No such file or directory

To Reproduce

pip install -U --pre torch_tensorrt --index-url https://download.pytorch.org/whl/nightly/cu121
python3 -c "import torch_tensorrt"

Error:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/ltewari/scratch/miniconda3/envs/nightly/lib/python3.9/site-packages/torch_tensorrt/__init__.py", line 102, in <module>
    _register_with_torch()
  File "/home/ltewari/scratch/miniconda3/envs/nightly/lib/python3.9/site-packages/torch_tensorrt/__init__.py", line 96, in _register_with_torch
    torch.ops.load_library(trtorch_dir + "/lib/libtorchtrt.so")
  File "/home/ltewari/scratch/miniconda3/envs/nightly/lib/python3.9/site-packages/torch/_ops.py", line 1242, in load_library
    ctypes.CDLL(path)
  File "/home/ltewari/scratch/miniconda3/envs/nightly/lib/python3.9/ctypes/__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libnvinfer_plugin.so.10: cannot open shared object file: No such file or directory

Environment

Build information about Torch-TensorRT can be found by turning on debug messages

  • Torch-TensorRT Version (e.g. 1.0.0): torch-tensorrt==2.4.0.dev20240429+cu121
  • PyTorch Version (e.g. 1.0): torch==2.4.0.dev20240507+cu121
  • CPU Architecture: x86_64
  • OS (e.g., Linux): Ubuntu
  • How you installed PyTorch (conda, pip, libtorch, source): pip (nightly)
  • Build command you used (if compiling from source): NA
  • Are you using local sources or building from archives: NA
  • Python version: Python 3.9.18
  • CUDA version: 12.4
  • GPU models and configuration: H100 PCIe
  • Any other relevant information:

laikhtewari avatar May 07 '24 15:05 laikhtewari

@laikhtewari do you have tensorrt installed?

narendasan avatar May 07 '24 18:05 narendasan

Looks like it, I have tensorrt==8.6.1.post1 Shouldn't that be installed automatically as a dependency when I pip install torch_tensorrt?

laikhtewari avatar May 07 '24 20:05 laikhtewari