nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

running semantic-nerfw on custom data

Open Mehi44 opened this issue 2 years ago • 5 comments

Has anyone been able to generate the same data format required for semantic-nerfw from their own dataset ?

Mehi44 avatar Jan 23 '23 03:01 Mehi44

I have the same question. Also the result of running semantic-nerfw on friends dataset using default settings doesn't look good.

yimingzhou1 avatar Feb 08 '23 17:02 yimingzhou1

Has anyone been able to generate the same data format required for semantic-nerfw from their own dataset ?

I want to know how to generate cameras.json?

cezarbbb avatar Feb 10 '23 13:02 cezarbbb

If you are interested in creating something with cameras.json format, you can reference this code and [this notebook](this notebook).

We recommend using nerfstudio if you want to do anything custom with semantics. You can copy the nerfstudio dataparser and then modify it to add semantics, like we do here.

ethanweber avatar Feb 10 '23 19:02 ethanweber

I have the same question. Also the result of running semantic-nerfw on friends dataset using default settings doesn't look good.

I don't expect the results to look good until transient embeddings from NeRF-W are implemented. If you are interested in working on this and making a PR, you could reference nerf_pl.

ethanweber avatar Feb 10 '23 20:02 ethanweber

Question to the participants in this discussion: Have any of you had succes with creating custom datasets for semantic_nerfw? If so would you be willing to share some knowledge with me? I am currently working on a project where this woud be very useful

AlexanderVoldby avatar Feb 28 '24 14:02 AlexanderVoldby