Retargeting retraining on customized dataset

[HaozhouPang]

Hello Peizhuo,

Thanks for making this amazing project public available!

I am trying to retrain the retargeting model on my own dataset, I have a new skeleton and its motion data. As your suggestion said the motion data should have the same T pose, does it mean the bvh files should start from the same T pose?

Thanks, Haozhou

[PeizhuoLi]

Thanks for your question. It doesn’t have to be exactly the same T-pose, but should be similar. Because in our experiment, drastically different T-poses may introduce extra burden to the network and eventually can fail it (in fig 15). In the pre-trained model, the T-poses in the dataset are similar but not the same.

Hope this can be helpful.

[HaozhouPang]

Thanks for your reply!

If I understand this correctly, the T-pose of different characters should be similar to get better result, but the bvh animations that used for trainning and inference does not need to start from T pose in the first frame, right?

Best, Haozhou

[PeizhuoLi]

You are correct!