First pass implementation of rtmpose3d

[S0yKaf]

Hello, Here's a first pass at implementing the new rtmpose3d model. Since the 3D model isn't provided in onnx by mmlab I converted it myself and uploaded it here:

https://huggingface.co/Soykaf/RTMW3D-x

I'd appreciate some feedback on the implementation, I tried my best. It seems to work well. I'm just unsure about the Z axis accuracy.

Progress

• [x] 2D skeleton visualization
• [x] multiple subject support
• [ ] openpose display
• [ ] 3D skeleton visualization
• [ ] format_result

Closes: #31

PS: getting mmpose setup was an absolute nightmare. So I'm forever grateful for this library.

[Tau-J]

Hi @S0yKaf , thanks for your contribution! Please feel free to contact me if this PR is ready. I'll review it asap.

[S0yKaf]

I added the bboxes support but it seems to make the output a bit unstable. maybe it's just that my PC can't handle it.

I'm tracking what else would need to be done to get feature parity with the 2D model but I think this is good for a first pass review. @Tau-J

I think the 3D visualization is a big enough task to be split in a different PR.

[davidpagnon]

Subscribing to this, as I'd be quite interested

[jerela]

I am also interested to see if work on integrating the 3D model into this repo continues.

[Tau-J]

Sorry for the late reply. I've been busy with work and haven't had time to review this PR. I may still need some time, and I apologize for the inconvenience caused :(

[yihang314]

Are you still working on this project, this is really interesting!

[BLukash]

Hey, any updates on merging this?

[Tau-J]

hi @S0yKaf , sorry to keep you waiting. I've tested your code locally and confirmed it runs without issues. I think your implementation is excellent, and I'll merge this PR. The only minor regret is that there's currently no 3D visualization code, but I'm still very grateful for your contribution.