oneformer3d icon indicating copy to clipboard operation
oneformer3d copied to clipboard

ScanNet Online Benchmark Timeout with `test_cfg.topk_insts=100` and `inst_score_thr=0.0001`

Open Treakun opened this issue 8 months ago • 3 comments

Thank you for your outstanding work. When you conducted the ScanNet online benchmark, could you please let me know which values you used for test_cfg.topk_insts and inst_score_thr? I set them to 100 and 0.0001 respectively, but the administrator informed me that my submission still timed out. Would you have any recommendations on how to resolve this issue?

Treakun avatar May 12 '25 13:05 Treakun

Actually, i don't remember, but topk_insts=100 sounds good. I think, inst_score_thr may be increased easily up to 0.01, or even 0.05.

filaPro avatar May 12 '25 15:05 filaPro

I've encountered a new issue: "No text files found in results archive". I used your code for submitting the benchmark and have checked that it complies with the 3D Semantic Instance Prediction submission format. Have you ever come across this problem?

Treakun avatar May 14 '25 12:05 Treakun

I think it is not an issue of oneformer3d, and the answer may be found in ScanNet issues.

filaPro avatar May 14 '25 13:05 filaPro

I have solved this problem, thanks for your reply

Treakun avatar May 20 '25 16:05 Treakun