svox2 icon indicating copy to clipboard operation
svox2 copied to clipboard

Can this method be used to synthesize panoramas?

Open HHHendricks opened this issue 3 years ago • 6 comments

Hello, this method is great! ! ! I would like to know if this method can be used to composite a panorama?

HHHendricks avatar Feb 24 '22 13:02 HHHendricks

As far as I understand it, the difference between a panorama and the 360 degree scenes that we evaluate on is that a panorama is typically background-only, and could probably be modeled more simply than a full Plenoxel grid (e.g. the foreground grid could be low resolution).

sarafridov avatar Feb 24 '22 22:02 sarafridov

I see. So can I generate a panorama directly with your code? If so how can I set the parameters?

HHHendricks avatar Feb 25 '22 06:02 HHHendricks

There is an option to render only the background of a scene so technically it might be possible. But the dataset you need to train a Plenoxel grid will be more then enought to create a panorama with much higher resolution and better quality in seconds using existing software like ptgui.

Visuals3D avatar Feb 27 '22 15:02 Visuals3D

When I train the TanksAndTempleBG dataset, I always run out of memory when the resolution is [640, 640, 640]. How can I adjust the parameters? The configuration I train on is a GTX Titan with 12212MB of video memory.

HHHendricks avatar Mar 03 '22 06:03 HHHendricks

To reduce the memory requirements there are a few things to try. You can try reducing the final resolution, changing the optimizer (from RMSProp to SGD; SGD uses much less memory but also require more tuning of learning rate), and/or increasing the regularizers to encourage more sparsity.

sarafridov avatar Mar 03 '22 17:03 sarafridov

I tried it, but got really bad results, I was wondering what graphics card memory you guys are using

HHHendricks avatar Mar 06 '22 04:03 HHHendricks