smplify-x icon indicating copy to clipboard operation
smplify-x copied to clipboard

where is images and keypoints for DATA_FOLDER?

Open TomatoBoy90 opened this issue 4 years ago • 11 comments

hi, your job so great .however,how to download those data?

TomatoBoy90 avatar Sep 18 '20 06:09 TomatoBoy90

you need to put image and keypoint, and use openpose to make keypoint

keeelho avatar Sep 24 '20 08:09 keeelho

Do you know what kind of format for images and keypoints? Can we use PNG images and 2D keypoints in JSON format?

tetsu avatar Nov 25 '20 02:11 tetsu

@tetsu Yes, the openpose keypoints is in Openpose json format and the images are in .png format.

Anirudh257 avatar Jan 14 '21 06:01 Anirudh257

hi, I would like to know how many images processed by openpose are enough to run in the model. @TomatoBoy90 @Anirudh257 @keeelho @geopavlakos

poincarelee avatar Jul 06 '21 02:07 poincarelee

@poincarelee one image is also fine to run the model.

Anirudh257 avatar Jul 06 '21 04:07 Anirudh257

Does Data_FOLDER have an existing file link, and what should the file format below it look like?

whois-byte avatar Nov 19 '21 02:11 whois-byte

@who123sy, it is like:

data_folder/
data_folder/images/
data_folder/images/image_1.jpg
data_folder/keypoints/
data_folder/keypoints/image_openpose_1.jpg

Anirudh257 avatar Nov 21 '21 10:11 Anirudh257

@Anirudh257 is it mandatory to use openpose,or will any keypoint detection like alphapose/deepcut/mediapipe work?

sparshgarg23 avatar Jan 09 '22 16:01 sparshgarg23

@sparshgarg23 anything will work. Follow the folder structure of the images and key points.

Anirudh257 avatar Jan 09 '22 20:01 Anirudh257

Ok,but mediapipe's output consists of detecing 33 landmarks(including full body face,hand and landmark),whereas open pose output consists of detecting 25 points.So wouldn't that be a problem when we are reprojecting the 3d points outputted by the model back into 2d? from mediapipe site The landmark model in MediaPipe Pose predicts the location of 33 pose landmarks from openpose Pose Output Format (BODY_25)

I mean the main goal of SMPL is to reduce the error between the projected 3d points and the 2d points,so wouldn't there be a dimensional mismatch. Thanks for taking the time to get back,hope you can clarify my doubt.

sparshgarg23 avatar Jan 09 '22 20:01 sparshgarg23

@sparshgarg23 Okay, that is true. Try to use the 25 keypoints corresponding to Openpose only. You may have to do some manual changes.

Anirudh257 avatar Jan 10 '22 05:01 Anirudh257