Increase the number of graphics cards. There is a memory shortage, CUDA out of memory。

[tmrjlu]

this is OK。 python launch.py --config configs/prolificdreamer.yaml --train --gpu 0,1,2,3,4 system.prompt_processor.prompt="a blue car"

this is a memory shortage. python launch.py --config configs/prolificdreamer.yaml --train --gpu 0,1,2,3,4,5 system.prompt_processor.prompt="a blue car"

The other parameters are exactly the same.

why?

[bennyguo]

This is weird. Did the OOM occur at the start of training or after some training steps? Could you try some seeds or other prompts to see if this still happens?

[tmrjlu]

hi，this problem does not exist in the latest code