nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

There's a way to export the depth map and the mask of each frame please?

Open assia855 opened this issue 1 year ago • 3 comments

assia855 avatar Jun 08 '23 14:06 assia855

Use the --rendered-output-names argument, so for depth it is --rendered-output-names depth https://docs.nerf.studio/en/latest/reference/cli/ns_render.html

For an accumulation mask use accumulation key. Not that in normal scenes trained in nerfacto there won't be a mask unless you are using a crop.

tancik avatar Jun 08 '23 15:06 tancik

Hi @tancik thanks for your reply. Why when I launch : ns-train nerfacto --data '/path/to/data' --rendered-output-names 'depth' I have an error that it isn't the right argument.

assia855 avatar Jun 09 '23 07:06 assia855

This is an option to ns-render, not ns-train. Here's what you would use to render masks (aka accumulation):

ns-render ... \
--output-format images --image-format png --rendered-output-names accumulation \
--colormap-options.colormap gray --colormap-options.colormap-min 0. --colormap-options.colormap-max 1.

The gray colormap should be available shortly in nerfstudio (see https://github.com/nerfstudio-project/nerfstudio/pull/2058).

There's also a pending fix to be able to correctly render all input frames https://github.com/nerfstudio-project/nerfstudio/pull/2059 but it should already render correctly all frames except the last if all your frames use the same camera intrinsics.

#2059 also adds bounding box options to all render modes

f-dy avatar Jun 12 '23 01:06 f-dy