mmaction2 icon indicating copy to clipboard operation
mmaction2 copied to clipboard

Impossibility to understand how to create and train custom dataset[Docs]

Open gguzzy opened this issue 1 year ago • 1 comments

The doc issue

Good morning everyone, I want to point out that the 'ntu_pose_extraction,py' is not working as expected, morever for me it just works on cpu device.

Moreover, I would like to understand, how starting from raw videos we can obtain spatio temporal annotated videos to put as input features the skeleton actions to feed both 2d till 4d stream (as wrote in the paper).

My question is, how would we be able to convert these video into feedable annotations? Creating pickles seems a bit weird, since it is reported that each one should be merged together to train our final model, but with which criteria?

An example on how to create a small dataset and train it wouldnt be bad at all, if you want I might help you building that for further references.

Thanks a lot.

Gianluca

Suggest a potential alternative/fix

No response

gguzzy avatar May 10 '24 16:05 gguzzy

@cir7 Furthermore, it would be helpful to include a conversion script from COCO format outputs obtained with MMPose to this MMAction pkl format.

borschy avatar Apr 09 '25 09:04 borschy