lightweight-human-pose-estimation.pytorch icon indicating copy to clipboard operation
lightweight-human-pose-estimation.pytorch copied to clipboard

Custom Dataset Annotation format

Open JJLimmm opened this issue 1 year ago • 4 comments

Hi,

I have a few questions after reading the tips and issues pointed out here. I am currently using Labelme to annotate the keypoints and would convert them to the COCO format later on.

  1. What if my custom dataset only has keypoints annotated?

  2. If i have the 18 keypoints like shown in the image below, where can i change the keypoint definitions in this repo to match my usage?
    pose_estimation_keypoints

  3. And for Validation of the model, are other metrics available like PCK, PCP (more info)? Would i be able to use your validation metrics with just keypoints in my GTs?

Thanks!

Originally posted by @JJLimmm in https://github.com/Daniil-Osokin/lightweight-human-pose-estimation.pytorch/issues/231#issuecomment-1207600173

JJLimmm avatar Aug 08 '22 03:08 JJLimmm

Hi! It is ok, you can convert this format to COCO annotation format. Just throw away the neck and reorder keypoints as in COCO dataset, you can check #134 or the official COCO site for the COCO keypoints order. You can check additional metric in the neighborhood repository. It has the code for a single-person pose estimation.

Daniil-Osokin avatar Aug 08 '22 16:08 Daniil-Osokin

Thanks @Daniil-Osokin . For my first pointer i think you missed that out by accident, but is it okay if i only have keypoints for my annotations? (no bboxes or segmentations)

JJLimmm avatar Aug 10 '22 01:08 JJLimmm

To use the code without modifications, you need to convert the data to COCO format. You can take just bounding box around person keypoints. Segmentation, masks are not necessary, check the #231.

Daniil-Osokin avatar Aug 10 '22 16:08 Daniil-Osokin

I see, so i can do without segmentation masks, but i would still require bounding boxes with my keypoints, so as to use it with COCO's evaluation metrics.

JJLimmm avatar Aug 12 '22 06:08 JJLimmm

Great, that it is clear now!

Daniil-Osokin avatar Aug 16 '22 18:08 Daniil-Osokin