Hand4Whole_RELEASE icon indicating copy to clipboard operation
Hand4Whole_RELEASE copied to clipboard

Training problem

Open Julylala opened this issue 1 year ago • 6 comments

Hello, can you help me to see what might be wrong? I only used MPII data for training, and then generated the model after the second stage for running the demo, but the following error was reported. Thanks a lot!

trainset_3d = []
trainset_2d = ['MPII'] 

Using GPU: 0 Load checkpoint from ./snapshot_6.pth.tar Traceback (most recent call last): File "demo.py", line 84, in rendered_img = render_mesh(vis_img, mesh, smpl_x.face, {'focal': focal, 'princpt': princpt}) File "/home/na/main/../common/utils/vis.py", line 134, in render_mesh mesh = pyrender.Mesh.from_trimesh(mesh, material=material, smooth=False) File "/home/anaconda3/envs/torch/lib/python3.7/site-packages/pyrender/mesh.py", line 205, in from_trimesh positions = m.vertices[m.faces].reshape((3 * len(m.faces), 3)) IndexError: index 0 is out of bounds for axis 0 with size 0

Julylala avatar Nov 15 '23 12:11 Julylala

please check dimension of vis_img and mesh

mks0601 avatar Nov 15 '23 23:11 mks0601

I printed out their shape information, but it looks correct. Shape of vis_img: (512, 384, 3) Shape of mesh: (10475, 3),

And confused, the pre-trained model I downloaded worked fine, but the model I trained with this MPII data had this problem.

Julylala avatar Nov 16 '23 02:11 Julylala

can you save mesh and visualize it through meshlab

mks0601 avatar Nov 16 '23 02:11 mks0601

MESHLAB reported an error: Warning mesh contains 10475 vertices with NAN coords and 0 degenerated faces. Corrected. Opened mesh C:/Users/19626/Desktop/output.obj in 101176 msec All files opened in 101177 msec.

Maybe there's something wrong with my model training.

Julylala avatar Nov 16 '23 03:11 Julylala

I think so. Basically, MPI dataset only has 2D body data, so it's not a good idea to train a model only on that dataset

mks0601 avatar Nov 16 '23 03:11 mks0601

Received, and thank you very much for your guidance.

Julylala avatar Nov 16 '23 03:11 Julylala