neuralangelo icon indicating copy to clipboard operation
neuralangelo copied to clipboard

SCENE_TYPE=outdoor make loss=NAN and train stop

Open Dragonkingpan opened this issue 2 years ago • 1 comments

I have an outdoor scene where the camera is not rotating around an object, but rather walking a long distance around a building. I set the parameter SCENE_ TYPE=exterior. As a result, when I took the first step of training, there was a loss=NAN error, and the training was terminated. I will call this parameter back to the object, and this error will no longer occur. I would like to ask what the meaning of this parameter is, and will using the object in my outdoor scene cause any other errors?

Dragonkingpan avatar Sep 08 '23 11:09 Dragonkingpan

Hi @Dragonkingpan

The scene_type has two use cases:

  • Deciding the bounding box here. If the trajectory is similar to an object-centric scene, it will use the poses to bound the scene. Otherwise, it will use the SfM points.
  • Deciding the # of initial active levels here. We use more initialized levels if the scene scale is large.

Can you check which of the above leads to your problem? My guess is that the bounding box is the issue. For outdoor scenes, the camera trajectory can be arbitrary, so there is very little prior info that we can use in comparison to an object-centric scene. The script tries its best to bound the scene, however, sometimes this is not sufficient.

mli0603 avatar Sep 08 '23 16:09 mli0603