BEVDepth icon indicating copy to clipboard operation
BEVDepth copied to clipboard

training speed very slow

Open xiaocongcsu opened this issue 3 years ago • 7 comments

The training speed is very slow, did anybody encounter this problem? image

And the GPU is in use: image

xiaocongcsu avatar Dec 09 '22 06:12 xiaocongcsu

You may try to raise workers_per_gpu.

yinchimaoliang avatar Dec 13 '22 11:12 yinchimaoliang

You may try to raise workers_per_gpu.

I tried it but it's much slower...

clw5180 avatar Jan 06 '23 11:01 clw5180

Have you solved this problem? I encounter the same issue with the A100 GPU.

zhangzaibin avatar Jan 13 '23 12:01 zhangzaibin

The processing of radar point cloud is too time-consuming. You can try the method in Bevstereo. Store the point cloud as an npy file, and then read it.

qfwysw avatar Jan 24 '23 12:01 qfwysw

The processing of radar point cloud is too time-consuming. You can try the method in Bevstereo. Store the point cloud as an npy file, and then read it.

Thanks for your advice! Can you give me a demo code?

Zhangwenyao1 avatar Sep 10 '23 03:09 Zhangwenyao1

The training speed is very slow, did anybody encounter this problem? image

And the GPU is in use: image

Have you solved this problem?

Zhangwenyao1 avatar Sep 10 '23 03:09 Zhangwenyao1

Not solved yet, I used the implementation in BEVDet.

xiaocongcsu avatar Sep 12 '23 08:09 xiaocongcsu