Is engine thread safe?

[solaim]

Hi,

I want to use multi-thread to re-use engine, is this thread safe?

or any recommendations?

[Guanbin-Huang]

the class infer under TRT is not thread-safe. But the class infer in yolo is thread-safe. Check the the design in yolo. TRT 下的infer 不是线程安全 但是yolo 下的infer 下是线程安全 所以如果想要考虑线程安全 可以参考yolo 的设计