TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

The engine plan file is generated on an incompatible device

Open xiaoxiaozengzen opened this issue 3 years ago • 1 comments

Description

I encountered the following error：

The engine plan file is generated on an incompatible device, expecting compute 8.6 got compute 7.5, please rebuild.4: [runtime.cpp::deserializeCudaEngine::50] Error Code 4: Internal Error (Engine deserialization failed.)

I also checked the local graphics card version:

$ nvidia-smi -L
GPU 0: NVIDIA GeForce RTX 3080 (UUID: GPU-6936d668-679b-1cde-03ca-330bcc80d6dd)
GPU 1: NVIDIA GeForce RTX 3080 (UUID: GPU-957c0287-a401-4cf6-f000-ee9f66feeb2f)

The engine file corresponds to the graphics card version. I have no idea about this error.

What should I do, thx!

Environment

TensorRT Version: 8.2.5.1 NVIDIA GPU: 3080 NVIDIA Driver Version: CUDA Version: 11.1 CUDNN Version: 8.2.1 Operating System: linux

xiaoxiaozengzen avatar Jul 22 '22 02:07 xiaoxiaozengzen

The error is indicative, remove the plan and regenerate it with the correct device. e.g. with setting CUDA_VISIBLE_DEVICES

zerollzeng avatar Jul 22 '22 14:07 zerollzeng

closing since no activity for more than 3 weeks, please reopen if you still have question, thanks!

ttyio avatar Dec 06 '22 01:12 ttyio