Increasing GPU memory during training time: Cuda out for memory error

[lishiyu005]

Dear authors,

Thanks for your great work. When I try to train the models, the GPU memory increase from 10 GB in the beginning to more than 20GB after 300 batches. How did you solve the problems? Is there any way to fix this issue?

Best regards, Shiyu Li