Adding clothing capability to SMPL-X body model

[hshreeshail]

I am working on a problem which requires animating finger movements and facial expressions. Hence, I am using PIXIE, which uses the SMPL-X model. However, PIXIE works on the vanilla, undressed SMPL-X model. I was wondering what the easiest way is to add the clothing feature to PIXIE (i.e., I want PIXIE's output on a clothed SMPL-X model). It would suffice for the clothing/skin color to be a fixed value i.e., it doesn't have to be derived from the input image.

[garvita-tiwari]

You can add clothing as a displacement map on top of SMPL-X. You can refer to https://github.com/bharat-b7/MultiGarmentNetwork/blob/master/dress_SMPL.py for adding clothing on top of SMPL model.

[hshreeshail]

You can add clothing as a displacement map on top of SMPL-X. You can refer to https://github.com/bharat-b7/MultiGarmentNetwork/blob/master/dress_SMPL.py for adding clothing on top of SMPL model.

I tried this. I took the output of PIXIE (which is in the SMPL-X format), converted it to the SMPL format using this, and ran dress_SMPL.py on the SMPL model (I don't think MGN works with SMPL-X as input). While the dressing works ok, the SMPL model loses the hand articulation information. See Image below: SMPLX (left), SMPL (right).

I want to dress the model without losing the hand articulation. Is there any way to do this? Is there any existing work on dressing the SMPL-X model?