multinerf icon indicating copy to clipboard operation
multinerf copied to clipboard

How to make a color video?

Open 3Bridge123 opened this issue 2 years ago • 6 comments

Hi.

Thank you for your work. It's amazing!

I followed the README.md for training and rendering and got the following 4 videos.

checkpoints_my_dataset_dir_path_renders_step_0_acc.mp4 checkpoints_my_dataset_dir_path_renders_step_0_color.mp4 checkpoints_my_dataset_dir_path_renders_step_0_distance_mean.mp4 checkpoints_my_dataset_dir_path_renders_step_0_distance_median.mp4 image

But what I want is not a video like these heatmaps, but a color video like the demo.

How can I output a video like the demo?

3Bridge123 avatar Oct 13 '22 06:10 3Bridge123

The _color.mp4 video should be the RGB rendering. How do things look after you train for more than zero steps?

jonbarron avatar Oct 13 '22 16:10 jonbarron

@jonbarron Unfortunately I got the same issue:( The acc is totally white and the color is a mess.

cezarbbb avatar Oct 21 '22 06:10 cezarbbb

Can you share the rendering? And its filename?

jonbarron avatar Oct 21 '22 15:10 jonbarron

Can you share the rendering? And its filename?

the rendering is just the same as the questioner provided. And my filename is checkpoints_earphone_over_book_path_renders_step_0_color.mp4.

cezarbbb avatar Oct 23 '22 11:10 cezarbbb

Can you share the rendering? And its filename?

And my dataset worked well in the original nerf:(

cezarbbb avatar Oct 23 '22 11:10 cezarbbb

Since the filename has step_0_ in it, it seems like your training loop is doing zero steps of optimization, which will produce bad results. Sounds like there's something wrong with your training loop or how it's configured.

jonbarron avatar Oct 24 '22 16:10 jonbarron