Open-PIFuhd icon indicating copy to clipboard operation
Open-PIFuhd copied to clipboard

how to get ground truth of Normal ??

Open ylab604 opened this issue 2 years ago • 22 comments

how to get ground truth of Normal ??

ylab604 avatar Mar 02 '22 05:03 ylab604

U can use pyrender render or pytorch3d. when u render your normal map, u need to care of normal map directions. More specifically, when U rotate your mesh, your normal map also need to rotate degree the same as mesh. the normal map value is texture value when you render normal map.

lingtengqiu avatar Apr 18 '22 10:04 lingtengqiu

Thank you for your answer. Can't I use the data generation in your Github?

ylab604 avatar Apr 18 '22 10:04 ylab604

Please bash the script

bash ./scripts/generate.sh

lingtengqiu avatar Apr 18 '22 10:04 lingtengqiu

image image I extracted depth by modifying your code a little. Thank you. I used normalmap as it is. Can't I use it as it is?

ylab604 avatar Apr 18 '22 10:04 ylab604

I suggest u check whether the rotate normal map is right(especially for back view). Generally, the left side is closed to blue while right side is the red-category.

lingtengqiu avatar Apr 18 '22 12:04 lingtengqiu

Thank you so much for your kind explanation. Could you please tell me how to do it? I did normalmap rendering of the thuman2.0 dataset with your code, but it seems that i was wrong. Which part of the code should I fix?

ylab604 avatar Apr 18 '22 13:04 ylab604

image here is my result on thuman2.0 dataset

ylab604 avatar Apr 18 '22 13:04 ylab604

when i bash the script bash ./scripts/generate.sh there is a error ImportError: cannot import name 'mesh_core_cython' from 'engineer.render.face3d.mesh.cython' (unknown location) i don't know how to solve the problem could you give me some suggestion

lanlan17 avatar May 09 '22 01:05 lanlan17

sorry for late you need to set face3d go to https://github.com/YadiraF/face3d and follow read me for set engineer.render.face3d.mesh.cython

ylab604 avatar May 12 '22 10:05 ylab604

recently i also use Thuman2.0 dataset to conduct experiments. when i render the normal. the error is "mesh is non-watertight for contained point query!" have you encountered the similar problem?

lanlan17 avatar May 30 '22 07:05 lanlan17

hmm... I didn't get that error, sorry for not being helpful. In my case, I tried it first with Render People, then proceeded. I recommend that you try Render People first.

ylab604 avatar May 30 '22 07:05 ylab604

thank you for your reply! i have tried render people dataset! It worked. but Thuman2.0 has some problems.

lanlan17 avatar May 30 '22 08:05 lanlan17

If you write down the error in detail, I might be able to help, so please write in detail.

ylab604 avatar May 30 '22 08:05 ylab604

image like this,it doesn't generate normal map

lanlan17 avatar May 30 '22 09:05 lanlan17

i have solved the problem the reason is that i accidentally commented out part of the code earlier thank you again for your patience

lanlan17 avatar May 30 '22 09:05 lanlan17

Great! Have a good day!

ylab604 avatar May 30 '22 12:05 ylab604

i have solved the problem the reason is that i accidentally commented out part of the code earlier thank you again for your patience

hi, I have the same problem, but I donot change the code. where did you modify the code?

kings-rgb avatar Jul 27 '22 09:07 kings-rgb

i have solved the problem the reason is that i accidentally commented out part of the code earlier thank you again for your patience

hi, I have the same problem, but I donot change the code. where did you modify the code?

maybe the warning is related to your datasets, but it will not prevent you to generate the normal images

lanlan17 avatar Jul 27 '22 09:07 lanlan17

image image I extracted depth by modifying your code a little. Thank you. I used normalmap as it is. Can't I use it as it is?

Hey, could you tell me how to generate depth map? Many thanks.

yangqinhui0423 avatar May 09 '24 09:05 yangqinhui0423

build the generate depth code refer to generate normal code

ylab604 avatar May 09 '24 10:05 ylab604

build the generate depth code refer to generate normal code

Thanks for your quick answer! Does it mean refer to /tools/generate_normal_map.py in the project?

yangqinhui0423 avatar May 09 '24 10:05 yangqinhui0423

yes, I can't remember fully(because almost 2years ago). I think you would change the face3d render part (c++ part) normal 2 depth use depth formula

ylab604 avatar May 09 '24 10:05 ylab604