Scene or Bounding Box Rotation

[MvWouden]

Is your feature request related to a problem? Please describe. Currently, bounding box cropping can only be performed in an axis-aligned way. I would like to be able to rotate the scene or bounding box before cropping, to adjust for the (3D) rotation of objects. Instant-NGP allows you to do this already. It's useful e.g. when an object is presented on a flat surface, but the flat surface is not aligned with the axes.

Describe the solution you'd like Implement bounding box or scene rotation in the nerfstudio viewer. Can be done similarly as to how its done in Instant-NGP.

Describe alternatives you've considered Perhaps a flag for automatic scene-rotation could be added, which seeks to detect the "main" flat surface in the scene, after which the scene is rotated to align the flat surface with the axes. Overall, this seems a lot more complex than simply providing scene/BB rotation.

Additional context Was shortly discussed on the discord server to make sure this feature was indeed not implemented yet.

[f-dy]

First of all, if your vertical is not right, I would try --orientation-method vertical which fixes many issues with the default method (--orientation-method up), see https://github.com/nerfstudio-project/nerfstudio/issues/1765

If you implement another vertical detection (eg the "main" flat surface, which is something done by this paper https://github.com/DrawZeroPoint/hope), one easy way to test it is to modify the tranforms.json before launching ns-train.

[MvWouden]

First of all, if your vertical is not right, I would try --orientation-method vertical which fixes many issues with the default method (--orientation-method up), see https://github.com/nerfstudio-project/nerfstudio/issues/1765

If you implement another vertical detection (eg the "main" flat surface, which is something done by this paper https://github.com/DrawZeroPoint/hope), one easy way to test it is to modify the tranforms.json before launching ns-train.

Thanks for the reply. Yes I was able to solve it already, but I still think the feature would be useful to have.

[smart4654154]

Thank you very much for your work. My question seems to be related to this job. What is the meaning of the crop scale value in the new version of viewer? I found that the value of the crop scale cannot match the coordinate values of the world coordinate system. For example, when the crop scale is set to 4, 4, 4, it is approximately equivalent to a square with a side length of 40 in the world coordinate system What are the meanings of "crash max" and "crash min" in Viewer_legacy?

[hoanhle]

@MvWouden did you solve it by modifying tranforms.json before launching ns-train?