DirectVoxGO
DirectVoxGO copied to clipboard
Inward-facing scene poor quality - coarse model too dense
Hi,
I have trained an inward-facing scene of a can using 120 posed images from the YCB dataset in an equally spaced upper semi-sphere and used the 'nerf' config e.g.
_base_ = '../default.py'
expname = 'dvgo_Masterchefcan'
basedir = './logs/ycbrealworld'
data = dict(
datadir='./data/ycbrealworld/002_master_chef_can',
dataset_type='ycbrealworld',
white_bkgd=True,
)
coarse_train = dict(
pervoxel_lr_downrate=2,
N_iters=10000,
)
fine_train = dict(
N_iters=10000
)
Training images


Test renderings
Rendering the training poses works well, but the test poses have lots of distortion:

Coarse trained model
Viewing the coarse model, it looks like it is dense in a semi-spherical area around the can (essentially where all the cameras are pointing):

Is this normal? Is it likely to be the problem? How can this be fixed?
Thanks!
You should enable the background model or the background pixel will collapse to the foreground. Please see configs/nerf_unbounded/nerf_unbounded_default.py for more detail