Have you tried to deploy this engine in trtion inference server?

[KevinZhanggg]

if so, how does it perform? Thanks

[upczww]

Yes, I deploy it to triton, the inference time is 4 ms on T4.

[KevinZhanggg]

@upczww I am trying to deploy it to triton. I've generated an engine file and plugin. so. What is the next? Can you give some hint? Or Is there a tutorial that I can follow? Please help me out! I

[upczww]

You can follow the documentation. https://github.com/triton-inference-server/server/blob/r20.12/README.md#documentation

[greenkarson]

你好，我想问下您部署到trtion inference server是用得tensorrt还是torchscript

[upczww]

tensorrt

阙豆林 @.***> 于2021年5月20日周四 上午11:21写道：

你好，我想问下您部署到trtion inference server是用得tensorrt还是torchscript

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/upczww/YoLov5-TensorRT-NMS/issues/1#issuecomment-844654752, or unsubscribe https://github.com/notifications/unsubscribe-auth/AD3Y76LJES5EDNSBAEZUJODTOR537ANCNFSM4WZG3SCQ .

[greenkarson]

triton 推理这块得代码能提供下么感觉我推理得时候出得框不对

[upczww]

这个是对应yolov5-3.1版本的，先确保版本一致

[greenkarson]

好的，谢谢

[upczww]

dims: [1] reshape: { shape: [] }

xiaoxuesheng @.***>于2022年4月27日 周三19:48写道：

请问count的dims 是多少，谢谢

— Reply to this email directly, view it on GitHub https://github.com/upczww/YoLov5-TensorRT-NMS/issues/1#issuecomment-1110905863, or unsubscribe https://github.com/notifications/unsubscribe-auth/AD3Y76MTNNWYPVDUJ6H57GTVHESRJANCNFSM4WZG3SCQ . You are receiving this because you were mentioned.Message ID: @.***>