FastDeploy icon indicating copy to clipboard operation
FastDeploy copied to clipboard

--use_trt True 每一次build都要花费大量时间

Open kissablemt opened this issue 11 months ago • 1 comments

能否build一次后,有缓存,可以直接读取 https://github.com/PaddlePaddle/FastDeploy/tree/cc8d1f3c9f31ea4919972f14ee3eaaa9a09966e2/examples/vision/detection/yolov5lite/python 用的是这里的代码

kissablemt avatar Mar 14 '24 11:03 kissablemt

支持缓存,调用option.trt_option.serialize_file = "./test_model.trt",即会在首次初始化后,将模型缓存至这个文件,再次执行时,如若此文件存在,会优先加载这个缓存的文件,跳过build步骤

Jiang-Jia-Jun avatar Mar 18 '24 07:03 Jiang-Jia-Jun