Vehicle-CV-ADAS
Vehicle-CV-ADAS copied to clipboard
Published
20 hours ago •
jason-li-831202
jason-li-831202
大佬，运行demo.py报错，你之前遇到过吗
[TensorRT] ERROR: INVALID_STATE: std::exception
[TensorRT] ERROR: INVALID_CONFIG: Deserialize the cuda engine failed.
Traceback (most recent call last):
File "demo.py", line 221, in
laneDetector = UltrafastLaneDetectorV2(logger=LOGGER)
File "/media/huangzd5/handaphoser/projects/autodrive/Vehicle-CV-ADAS-master/TrafficLaneDetector/ultrafastLaneDetector/ultrafastLaneDetectorV2.py", line 208, in init
self._initialize_model(self.model_path, self.cfg)
File "/media/huangzd5/handaphoser/projects/autodrive/Vehicle-CV-ADAS-master/TrafficLaneDetector/ultrafastLaneDetector/ultrafastLaneDetectorV2.py", line 213, in _initialize_model
self.infer = TensorRTEngine(model_path, cfg)
File "/media/huangzd5/handaphoser/projects/autodrive/Vehicle-CV-ADAS-master/TrafficLaneDetector/ultrafastLaneDetector/ultrafastLaneDetectorV2.py", line 60, in init
self.context = self._create_context(engine)
File "/media/huangzd5/handaphoser/projects/autodrive/Vehicle-CV-ADAS-master/TrafficLaneDetector/ultrafastLaneDetector/ultrafastLaneDetectorV2.py", line 93, in _create_context
return engine.create_execution_context()
AttributeError: 'NoneType' object has no attribute 'create_execution_context'
PyCUDA ERROR: The context stack was not empty upon module cleanup.
A context was still active when the context stack was being cleaned up. At this point in our execution, CUDA may already have been deinitialized, so there is no way we can finish cleanly. The program will be aborted now. Use Context.pop() to avoid this problem.
The problem may be due to the version of the environment. The CUDA version I'm using is 11.4, and the TensorRT version is 8.4.x. Remember to deploy on a device that matches the environment used for converting ONNX to TensorRT.
inference速度會受cpu/gpu的影響，另外object detection和lanes detection使用上沒有平行運算所以inference相對較慢，也許可以使用multi-Progress的方式去處理會有所提升，在模型方面可以試著轉換fp16的精度去提升。
可以參考以下issue : https://github.com/jason-li-831202/Vehicle-CV-ADAS/issues/1#issuecomment-1432452737