yuchen-ji

Question about loss function

1

I noticed that you use 2d keypoints & relative cuboid dimensions for supervision, could i also use the 6-DOF pose for surpervision? this 6-DOF loss could backward correctly？Does PNP algorithm...

如何确定每帧视频中人物的对应关系

8

感谢您之前的指导，我已经可以根据单人视频的参数在unity中驱动单人模型了~ 对于人数不变的视频，我发现single_batch_results每帧输出的人物的参数的数组是对应的，第一帧的single_batch_results[0]和第二帧的single_batch_results[0]是同一个人。 但是对于人数变化的视频，请问我应该怎么知道每帧视频中人物是如何对应的呢~

some question about process 2d datasets

3

i found that you crop the closest person for 3d datasets if have multiple person in one image, but for 2d dataset you may crop all persons in one image....

I obtained the rotation matrices of each joint of SMPL from images using mmhuman3d. However, when I directly imported them into Unity to control the motion of the SMPL model...

May I ask what I should do if I want to resume training and modify my learning rate. I found that when resume is enabled, directly modifying the learning rate...

question about real robot data-collection and training.

2

Thanks for your solid work and patient answer. I want to use cliport to control real robot, but there are some confusing issues: 1. I noticed that in pybullet simulation...

Thanks for your open source environment！ If I want to define new robot tasks in this simulation environment, how should I generate data for Imitation Learning training? Can you provide...

Model generalization ability？

2

Can the model in this article be generalized on images outside the dataset, such as completing a masked chair image?

SMPLX model in ROS

8

Thanks for your great works! I have a little questions, i just learn a little about ROS, can your project realize the visualization of smpl model in Rviz?