SyncDreamer icon indicating copy to clipboard operation
SyncDreamer copied to clipboard

Published 20 hours ago • verified publisher icon liuyuan-pal

Generating from other views

Open mshahbazi72 opened this issue 1 year ago • 2 comments

Hi

Is it possible to generate images from other views different from the 16 views used during training? I assume it is not possible to generate more than 16 images, but I tried generating new views by replacing the camera parameters in the pickle file camera-16.pkl. However, I still get the same images when running generate.py. I suspect this might be because the camera parameters are over-written by the checkpoint

mshahbazi72 avatar Oct 23 '23 13:10 mshahbazi72

Hi, the model does not support the generation of images in other views. It is trained to generate 16 views on the elevation of 30 degrees and evenly distributed azimuth. These fixed viewpoints are hardcoded in the attention layers so that generating other views would be low-quality if we change these viewpoints.

liuyuan-pal avatar Oct 24 '23 13:10 liuyuan-pal

I want to run train_renderer.py to generate mesh file, how can I replaced with other views?

yuhuangyue avatar Jan 18 '24 09:01 yuhuangyue