object_relation_transformer
object_relation_transformer copied to clipboard
self-critical training [duration and memory occupation]
Hej,
thank you a lot for your great work and some nice code!
I have a question regarding the self-criticial extra training. I am not exactly sure if there is an issue with it, but could you please tell me, how much memory self-critical training should consume? I keep running into CUDA out of memory error with 3 GPUs, and I can see that self-critical training is really hungry for space...therefore, I wanted to hear from the authors of the paper how much space this extra training required in the original experiments? And was there any optimisation of the code to handle this issue?
Best, Nikolai.