mmaction2 icon indicating copy to clipboard operation
mmaction2 copied to clipboard

Real-time detection with mmaction2?

Open heylary opened this issue 2 years ago • 3 comments

Branch

main branch (1.x version, such as v1.0.0, or dev-1.x branch)

Prerequisite

Environment

Operating System: Win11 mmaction2 version: latest GPU/CPU: gpu

Describe the bug

As a beginner in using mmaction2, I am currently exploring the workflow for skeleton action recognition. I noticed that the suggested process involves using "mmdetection+mmpose+mmaction". However, when I tried running the demo, it appeared to be quite slow. Each step, from mmdetection to mmpose to mmaction, takes a significant amount of time to process. image

Reproduces the problem - code sample

No response

Reproduces the problem - command or script

No response

Reproduces the problem - error message

No response

Additional information

No response

heylary avatar Jun 14 '23 14:06 heylary

Hi, @heylary It's reasonable, the detection and pose models used here are not efficient enough. Actually, we're going to release a real-time skeleton-based gesture recognition project, which uses real-time detection and pose models, you could try it later.

cir7 avatar Jun 15 '23 02:06 cir7

Hi @cir7, I am wondering when are you going to release it and what will its name be? Also, what is the size of the model gonna be and can it be run on edge device? Thanks!

willswordh avatar Jun 26 '23 17:06 willswordh

I have tried using this for real-time recognition and it works OK, but the results are not very good。 https://github.com/open-mmlab/mmaction2/blob/main/demo/README.md#webcam-demo

Sleepingbug avatar Dec 13 '24 09:12 Sleepingbug