SegmentAnythingin3D icon indicating copy to clipboard operation
SegmentAnythingin3D copied to clipboard

About quantative result testing

Open BenyunZhao opened this issue 1 year ago • 6 comments

Dear authors, thank you very much for open source this amazing work.

I am a beginner in 3D rendering and SAM. I would like to learn from you how to test on the datasets of NVOS, spin-nerf and Replica.

Would you release the relevant test codes? It may be a great help.

BenyunZhao avatar Jan 24 '24 12:01 BenyunZhao

Hello! Thanks for your interest! The test code is not compatible with this GUI version currently. We will try to modify the code and provide it recently.

Jumpat avatar Jan 24 '24 12:01 Jumpat

Thank you so much for your reply.

That is a great great new!!! Thank you again. Looking forward to your updates about the testing codes, that will be a big help for me to learn NeRF and SAM.

BenyunZhao avatar Jan 24 '24 12:01 BenyunZhao

We update a python script here for evaluating IoU, and modify lib/render_utils.py to save rendered masks when using --dump_images.

As an interactive segment method, in the test stage, we choose the first frame in the train set to perform usr-specific segment, train our model at the rest images of the train set, and then save the masks rendered from test views. The masks are used to calculate iou with gts in lib/evaluate.py.

Zanue avatar Jan 29 '24 03:01 Zanue

Thank you so much!!

I will try as soon as possible and give some feedback to you, thanks again.

BenyunZhao avatar Jan 29 '24 07:01 BenyunZhao

Hi, may I ask about how to load the replica spin-nerf dataset like config/llff, lerf, nerf-360? Would you share the config files?

BenyunZhao avatar Jan 31 '24 03:01 BenyunZhao

lerf/nerf unbounded configs are general for outdoor scenes. You can simply modify them to get your configs.

Note if the camera poses in your dataset use LLFF/OpenGL format, we have inverse_y=False in the config in default. If the camera poses use OpenCV format, you should set inverse_y=True.

Zanue avatar Mar 05 '24 09:03 Zanue