Ratish Puduppully

Longformer EncoderDecoder (LED)-Large model finetuning for summarization results in </s><s><s><s><s><s><s><s><s><s><s>... output

9

### System Info - `transformers` version: 4.20.0.dev0 - Platform: Linux-4.18.0-348.23.1.el8_5.x86_64-x86_64-with-centos-8.6-Green_Obsidian - Python version: 3.7.13 - Huggingface_hub version: 0.7.0 - PyTorch version (GPU?): 1.11.0 (True) - Tensorflow version (GPU?): not installed...

Hi, I am on version 0.9.2. I am trying to train a multi-gpu model `python train.py -data data/demo -save_model demo-model -report_every 10 -world_size 4 -gpu_ranks 0 1 2 3 -batch_size...