nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

slow training speed with A100

Open DEVECLOVER opened this issue 1 year ago • 2 comments

Configure the environment according to the tutorial, test the training example-dtu-scan65 , and find that the training speed is very slow, however the tutorial says that the 3090 can reach the training speed of 15 minutes and 20K iterations: image

my training command 、info and progress as follows:

ns-train neus-facto --pipeline.model.sdf-field.inside-outside False --vis viewer --experiment-name neus-facto-dtu65 sdfstudio-data --data data/sdfstudio-demo-data/dtu-scan65

image image image

As we can see, the GPU utilization is very low, I haven't made any changes to the source code, don't know what caused it.

At the same time, I configured the server with 3090, and the test speed was much faster:

image

image

Thank you!!!

DEVECLOVER avatar Nov 04 '23 03:11 DEVECLOVER

@DEVECLOVER Hi, have you solved this issue?

OrangeSodahub avatar Jan 10 '24 07:01 OrangeSodahub

I also have problems, it does not run with Google Colab https://colab.research.google.com/github/nerfstudio-project/nerfstudio/blob/main/colab/demo.ipynb

It is stuck at this image

kesitrifork avatar Apr 09 '24 18:04 kesitrifork