HumanGaussian icon indicating copy to clipboard operation
HumanGaussian copied to clipboard

The problem of view dependent prompt

Open DSaurus opened this issue 2 years ago • 3 comments

It appears that the SMPLX coordinate system is not aligned with the threestudio coordinate system, resulting in incorrect view-dependent prompts during generation. For instance, an azimuth angle of around -180 should represent a side view, but it currently also corresponds to a back view.

problem view

DSaurus avatar Dec 07 '23 16:12 DSaurus

Hi:

Many thanks for pointing out this problem! I guess there could be some camera coordinate-related issues. Currently, it's OK since we have the per-view body skeleton as an input condition, so the generation correctness is guaranteed by structural guidance (i.e., even if we give a wrong view-dependent prompt of back-view, the skeleton can tell the model it's actually a side-view).

Thanks again for notifying this and we will update it in later commits:)

Best

alvinliu0 avatar Dec 09 '23 13:12 alvinliu0

@alvinliu0 Hello, have you updated this issue, I also came across this issue, resulting in one human face in the front view and one human face in the back view.

y6216886 avatar Dec 19 '23 02:12 y6216886

@alvinliu0 Hello, have you updated this issue, I also came across this issue, resulting in one human face in the front view and one human face in the back view.

Hi, the bugs don't seem to be fixed!

XiaokunSun avatar Mar 04 '24 06:03 XiaokunSun