gpu-rest-engine icon indicating copy to clipboard operation
gpu-rest-engine copied to clipboard

TensorRT 6 for detection + classification

Open mkh-github opened this issue 5 years ago • 2 comments

Using gpu-rest-engine, i created a service that could detect, classify -or- detect and then classify. First step is to do detection with SSD using of a single class (other than background), and then take crops from the bounding boxes and run through a googlenet classiifer.

Would I be able to do the same with TRT inference server? or would I need to use https://github.com/NVIDIA/tensorrt-laboratory?

Thanks!! the gpu-rest-engine has worked very well, but wanting to upgrade to TRT 6 and having issues.

mkh-github avatar Oct 03 '19 00:10 mkh-github

Hello @mkh-github. You should ask them directly on their GitHub. TRTIS is open source too: https://github.com/NVIDIA/tensorrt-inference-server

They will be in a better position to answer you.

flx42 avatar Oct 03 '19 01:10 flx42

TRTIS has an ensemble API which allows you to chain models together.

ryanolson avatar Nov 03 '19 16:11 ryanolson