nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

Add default limit to number of training images

Open kevinddchen opened this issue 2 years ago • 0 comments

This PR changes the default value of --pipeline.datamanager.train-num-images-to-sample-from to 300 to avoid OOM when caching train data for large datasets. Also, the configuration --pipeline.datamanager.train-num-times-to-repeat-images is added which controls how often to resample images from the total dataset, if it is too large to cache.

The Record3D data parser's --max_dataset_size configuration is now bypassed, since the handling of cached data is done better in the DataLoader.

I also add some console debug logging, to warn users when not all the training images are being used.

Looking for feedback on this PR!

This finishes the remaining tasks in #833

kevinddchen avatar Oct 29 '22 06:10 kevinddchen