4d-gaussian-splatting icon indicating copy to clipboard operation
4d-gaussian-splatting copied to clipboard

It seems that CUDA is not enabled

Open cmh1027 opened this issue 1 year ago • 6 comments

image image The program is strangely slow and it seems that the computation is done on CPU, not cuda (As you can see in the image, CPU utilization is 2108%) It's quite weird because I checked that parameters in GaussianModel are loaded on cuda. Modified diff-gaussian-rasterization package is highly suspicious.

cmh1027 avatar Feb 07 '24 06:02 cmh1027

100% modified diff-gaussian-rasterization is missing CUDA optimisations / overwritten this is not running on CUDA other then loading.

jamesjjk avatar Feb 12 '24 21:02 jamesjjk

@jamesjjk Maybe I have to compare the code with the original one before authors reply the issue

cmh1027 avatar Feb 13 '24 02:02 cmh1027

Thanks for your interest. It's impractical to run CUDA kernel on CPU. I suspect the I/O bottleneck is the culprit for your slowly training. If you have sufficient memory, you can try to disable the dataloader.

Alexander0Yang avatar Feb 13 '24 04:02 Alexander0Yang

same here... training on dynerf dataset is extremely slow (~1.12it/s) also, loss backward done per instance within a batch was also confusing and slow...

Zerg-Overmind avatar Feb 18 '24 23:02 Zerg-Overmind

same problem. 1.3it/s on RTX 3090

feixue94 avatar Apr 23 '24 16:04 feixue94

It seem to KNN's problem. If you disable rigid loss, it will be faster.

qrcat avatar Aug 05 '24 09:08 qrcat