transfer-learning-conv-ai icon indicating copy to clipboard operation
transfer-learning-conv-ai copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Out of memory XLM-roberta-large

Open hadifar opened this issue 5 years ago • 0 comments

Thanks for releasing your code. I replaced GPT2 with XLM-roberta-large, tensor dataset with LazyLoader, and did padding inside the data loader. Unfortunately, even with batch_size of 1, I got Cuda out of memory. Do you have any suggestions on how can I decrease memory usage? I have no problem with xlm-roberta-base.

hadifar avatar Oct 27 '20 10:10 hadifar