audio2photoreal icon indicating copy to clipboard operation
audio2photoreal copied to clipboard

Novel view

Open ggfresh opened this issue 1 year ago • 1 comments

Awesome project! Where could I set the camera params for rendering novel view?

ggfresh avatar Jan 12 '24 07:01 ggfresh

Hi, thanks!! For the camera params, you could change the K and Rt matrix that is getting passed into the renderer.

So for instance, I am just loading in some default camera parameters as per this line here: https://github.com/facebookresearch/audio2photoreal/blob/548aeeb2057465045ca1568d65ea059cea633d80/visualize/render_codes.py#L89

And passing in the parameters to the model here https://github.com/facebookresearch/audio2photoreal/blob/548aeeb2057465045ca1568d65ea059cea633d80/visualize/render_codes.py#L121

This is where these things get ingested. https://github.com/facebookresearch/audio2photoreal/blob/548aeeb2057465045ca1568d65ea059cea633d80/visualize/ca_body/models/mesh_vae_drivable.py#L283-L285

Since different parts of the body decoder use either the K or the Rt, you will need to set both. Hope this helps!

evonneng avatar Jan 12 '24 18:01 evonneng

Closing this issue as it seems resolved. Please reopen if you have more questions.

alexanderrichard avatar Jan 16 '24 21:01 alexanderrichard