nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

poor result on custom images

Open hanjoonwon opened this issue 1 year ago • 7 comments

image my image

and wandb log https://wandb.ai/ju805604/nerfstudio-project/runs/al6hxx7p?workspace=user-ju805604

image result

i trained with ns-train nerfacto --pipeline.datamanager.train-num-rays-per-batch 2048 --experiment-name actocat --max-num-iterations 100000 --vis viewer+wandb --data custom/processdata/cat nerfstudio-data

and export ns-export poisson --load-config outputs/actocat/nerfacto/2024-02-13_112157/config.yml --output-dir exports/mesh/CAT --target-num-faces 50000 --num-pixels-per-side 2048 --num-points 1000000 --remove-outliers True --normal-method open3d --use_bounding_box False --obb_center 0.0000000000 0.0000000000 0.0000000000 --obb_rotation 0.0000000000 0.0000000000 0.0000000000 --obb_scale 1.0000000000 1.0000000000 1.0000000000

hanjoonwon avatar Feb 14 '24 04:02 hanjoonwon

Have you looked at the trained nerf in the viewer? how does the actual model itself look?

kerrj avatar Feb 14 '24 18:02 kerrj

Have you looked at the trained nerf in the viewer? how does the actual model itself look?

Viewer looks very good. The object is clearly rendered

hanjoonwon avatar Feb 15 '24 13:02 hanjoonwon

Screenshot from 2024-03-01 17-43-39

I have same problem. Looks like something is wrong with exporting.

konfalkon avatar Mar 01 '24 16:03 konfalkon

Hi, did you try this: --pipeline.model.predict-normals True , for training?

hex41434 avatar Mar 26 '24 10:03 hex41434

Hi, did you try this: --pipeline.model.predict-normals True , for training?

yes, of course

konfalkon avatar Mar 26 '24 17:03 konfalkon

Using the bounding box option instead of obb worked for me. Try this. ns-export poisson --load-config outputs/actocat/nerfacto/2024-02-13_112157/config.yml --output-dir exports/mesh/CAT --target-num-faces 50000 --num-pixels-per-side 2048 --num-points 1000000 --remove-outliers True --normal-method open3d --use_bounding_box True --bounding-box-min -1 -1 -1 --bounding-box-max 1 1 1

HeaIn avatar Apr 15 '24 08:04 HeaIn

Hello, same problem here. @HeaIn I tried your command but nothing changed. On the older verisons of nerfstudio there was an AABB in which the scene was scaled inside it. Now seems like the scene is infinite and the algorithm renders more useless pixels which cause noise. I tried to crop the scene but the results was the same. Also the crop is not the same as earlier with scaled down the AABB. I dont know how the mesh extraction could work. This is the mesh extraxtion with poisson Screenshot 2024-07-24 124204 while this is my render Screenshot 2024-07-24 124619

vrahnos3 avatar Jul 24 '24 09:07 vrahnos3