Another solution of RuntimeError: CUDA error: device-side assert triggered

[minkichunm]

When I ran into this issue, the only solution I found was reducing learning rate. However, it didn't work for me when I change min_lr_ratio or basic_lr_per_img.

When I reduced batch size from 8 to 4, it worked. I think that it is related with the number of iterations. When the number of iterations is around 10,000 then that error appears.

Here is my command that I typed !python tools/train.py -f exps/example/yolox_voc/yolox_voc_nano.py -d 1 -b 4 --fp16 -o -c /content/yolox_nano.pth

[fengkh]

Did you find the reason why this Error happens? I met the same error. So upset.....