yolov7-pose icon indicating copy to clipboard operation
yolov7-pose copied to clipboard

Deepstream integration for Yolo-pose

Open KushalHM opened this issue 2 years ago • 7 comments

Hi, Great work with the repo, Thank you for that. I was able to generate a yolo pose fp16 engine using this repo and get it to work on my GPU (RTX 2070). Have you tried or are you aware of using the generated engine with nvinfer plugin of deepstream? I want to use it in deepstream 6.1.1 (with Cuda 11.7).

KushalHM avatar Jan 27 '23 23:01 KushalHM

can you tell me, what version of tensorrt you using? i am having issue on creating tensorrt engine.

MariJothi avatar Feb 15 '23 08:02 MariJothi

I am also interested in deploying the key point model with deepstream. Any update on this?

aurelm95 avatar Feb 15 '23 10:02 aurelm95

can you tell me, what version of tensorrt you using? i am having issue on creating tensorrt engine.

Hi, the tensorrt version is 8.5.2.2 but I had it also working in tensorrt 8.4.1. One thing to note, depending on the cuda/tensorrt version, the node numbers in the onnx file will change in add_custom_yolo_op.py. Please use netron to visualize the onnx model and use the correct numbers for inputs.

KushalHM avatar Feb 16 '23 17:02 KushalHM

I am also interested in deploying the key point model with deepstream. Any update on this?

No update yet. I am keeping an eye on this repo also to see if there is any update, https://github.com/marcoslucianops/DeepStream-Yolo.git. Might have to write the custom yolov7-pose deepstream inference + post processing plugin myself.

KushalHM avatar Feb 16 '23 17:02 KushalHM

I am trying to integrate the model yolov7-w6-pose-sim-yolo-fp16.engine on Deepstream but I get this error

image

MarcoPrassel avatar Mar 24 '23 10:03 MarcoPrassel

I am interested in learning how to develop the neccessary plugins ando/or parsers for yolo pose deepstream. How could I start ? is there any documentation for that?

btw, @MarcoPrassel , could you share your progress with the code?

aurelm95 avatar Mar 24 '23 12:03 aurelm95

Hi I used yolov8-pose (which supports dynamic batch processing) instead and integrated it into the Deepstream Python API. Detailed in deepstream-yolo-pose

YunghuiHsu avatar Jul 11 '23 03:07 YunghuiHsu