gaussian-splatting icon indicating copy to clipboard operation
gaussian-splatting copied to clipboard

CUDA error: an illegal memory access was encountered

Open tingzhongyue opened this issue 6 months ago • 11 comments

Hi, Thanks a lot for sharing your great work. I've built the environment properly and while running the DTU dataset, I try to use the rasterization to render the image. But I got following error: Traceback (most recent call last): File "train.py", line 225, in main() File "train.py", line 150, in main train_epoch(config, File "/root/autodl-tmp/idea/scripts/trainer.py", line 94, in train_epoch image = render(view, pc, background, config, device)["render"].cuda() File "/root/autodl-tmp/idea/gaussian_renderer/init.py", line 80, in render "visibility_filter" : radii > 0, RuntimeError: CUDA error: an illegal memory access was encountered Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Any idea how to resolve?

My system & settings: RTX3090 Linux 20.04

I hope I can get some solution for this problem!

Thank you.

tingzhongyue avatar Feb 17 '24 01:02 tingzhongyue

Hi,

Check out this issue and the corresponding PR that is linked here . Should help :)

gaetan-landreau avatar Feb 19 '24 13:02 gaetan-landreau

same RTX3090 Linux 20.04

same error has any solution yet? try here but not work

MouseChannel avatar Mar 06 '24 14:03 MouseChannel

Hi, Thanks a lot for sharing your great work. I've built the environment properly and while running the DTU dataset, I try to use the rasterization to render the image. But I got following error: Traceback (most recent call last): File "train.py", line 225, in main() File "train.py", line 150, in main train_epoch(config, File "/root/autodl-tmp/idea/scripts/trainer.py", line 94, in train_epoch image = render(view, pc, background, config, device)["render"].cuda() File "/root/autodl-tmp/idea/gaussian_renderer/init.py", line 80, in render "visibility_filter" : radii > 0, RuntimeError: CUDA error: an illegal memory access was encountered Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Any idea how to resolve?

My system & settings: RTX3090 Linux 20.04

I hope I can get some solution for this problem!

Thank you.

have you fix it up?

MouseChannel avatar Mar 06 '24 14:03 MouseChannel

您好,非常感谢您分享您的出色工作。我已经正确构建了环境,并且在运行 DTU 数据集时,我尝试使用光栅化来渲染图像。但我收到以下错误: Traceback (most最近一次调用最后): File "train.py", line 225, in main() File "train.py", line 150, in main train_epoch(config, File "/root/autodl -tmp/idea/scripts/trainer.py",第 94 行,在 train_epoch 中 image = render(view, pc, background, config, device)["render"].cuda() 文件 "/root/autodl-tmp/idea /gaussian_renderer/ init .py”,第 80 行,渲染“visibility_filter”:半径 > 0,运行时错误:CUDA 错误:遇到非法内存访问编译以TORCH_USE_CUDA_DSA启用设备端断言。知道如何解决吗? 我的系统和设置:RTX3090 Linux 20.04 我希望我能为这个问题找到一些解决方案! 谢谢。

你修好了吗?

Are you using the source code? The reason I had problems was that I got the degree of the spherical harmonics wrong.

tingzhongyue avatar Mar 08 '24 06:03 tingzhongyue

same RTX3090 Linux 20.04

same error has any solution yet? try here but not work

I meet the same problem. Have you fixed it up?

JrMeng0312 avatar Apr 04 '24 03:04 JrMeng0312

Perhaps just ensure that all the parameters passed to gaussian_renderer is on the same device, i also got this error when i tried to modify something, finally i found some parameters is on cpu, and i changed it to cuda, everything worked.

MilesCool avatar Apr 04 '24 08:04 MilesCool

same RTX3090 Linux 20.04 same error has any solution yet? try here but not work

I meet the same problem. Have you fixed it up?

I have solved this problem. you just need to install the version of diff-gaussian-rasterization

tlxhlll avatar Apr 16 '24 04:04 tlxhlll

I have solved this problem. you just need to install the version of diff-gaussian-rasterization

tlxhlll avatar Apr 16 '24 04:04 tlxhlll

Perhaps just ensure that all the parameters passed to gaussian_renderer is on the same device, i also got this error when i tried to modify something, finally i found some parameters is on cpu, and i changed it to cuda, everything worked.

thank you ! it work!

this233 avatar Apr 18 '24 12:04 this233

您好,非常感谢您分享您的出色工作。我已经正确构建了环境,并且在运行 DTU 数据集时,我尝试使用光栅化来渲染图像。但我收到以下错误: Traceback (most最近一次调用最后): File "train.py", line 225, in main() File "train.py", line 150, in main train_epoch(config, File "/root/autodl -tmp/idea/scripts/trainer.py",第 94 行,在 train_epoch 中 image = render(view, pc, background, config, device)["render"].cuda() 文件 "/root/autodl-tmp/idea /gaussian_renderer/ init .py”,第 80 行,渲染“visibility_filter”:半径 > 0,运行时错误:CUDA 错误:遇到非法内存访问编译以TORCH_USE_CUDA_DSA启用设备端断言。知道如何解决吗? 我的系统和设置:RTX3090 Linux 20.04 我希望我能为这个问题找到一些解决方案! 谢谢。

你修好了吗?

Are you using the source code? The reason I had problems was that I got the degree of the spherical harmonics wrong.你在使用源代码吗?我有问题的原因是,我把球谐函数的次数弄错了。

Hi, how did you solve it? I have the same problem, but other methods didn't work.

cat-fish-yu avatar Apr 26 '24 03:04 cat-fish-yu

Hi, Thanks a lot for sharing your great work. I've built the environment properly and while running the DTU dataset, I try to use the rasterization to render the image. But I got following error: Traceback (most recent call last): File "train.py", line 225, in main() File "train.py", line 150, in main train_epoch(config, File "/root/autodl-tmp/idea/scripts/trainer.py", line 94, in train_epoch image = render(view, pc, background, config, device)["render"].cuda() File "/root/autodl-tmp/idea/gaussian_renderer/init.py", line 80, in render "visibility_filter" : radii > 0, RuntimeError: CUDA error: an illegal memory access was encountered Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Any idea how to resolve?嗨,非常感谢分享您的伟大工作.我已经正确地构建了环境,在运行DTU数据集时,我尝试使用光栅化来渲染图像。但我得到了以下错误:Traceback(most recent call last):File“train.py“,line 225,in main()File“train.py”,line 150,in main train_epoch(config,File“/root/autodl-tmp/idea/scripts/trainer.py“,line 94,in train_epoch image = render(view,pc,background,config,device)[“render”].cuda()File“/root/autodl-tmp/idea/gaussian_renderer/init.py“,line 80,in render“visibility_filter”:radius> 0,RuntimeError:CUDA error:an illegal memory access was encountered Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.有办法解决吗? My system & settings: RTX3090 Linux 20.04我的系统和设置:RTX 3090 Linux 20.04 I hope I can get some solution for this problem!我希望我能找到解决这个问题的方法! Thank you. 谢谢

have you fix it up?你修好了吗?

Have you fix it up?

cat-fish-yu avatar Apr 29 '24 02:04 cat-fish-yu