object_relation_transformer icon indicating copy to clipboard operation
object_relation_transformer copied to clipboard

self-critical training [duration and memory occupation]

Open nilinykh opened this issue 3 years ago • 1 comments

Hej,

thank you a lot for your great work and some nice code!

I have a question regarding the self-criticial extra training. I am not exactly sure if there is an issue with it, but could you please tell me, how much memory self-critical training should consume? I keep running into CUDA out of memory error with 3 GPUs, and I can see that self-critical training is really hungry for space...therefore, I wanted to hear from the authors of the paper how much space this extra training required in the original experiments? And was there any optimisation of the code to handle this issue?

Best, Nikolai.

nilinykh avatar May 05 '21 20:05 nilinykh