Raj Dabre

You don't need root access to install to a local folder btw.

Ahh I have had issues with the build tools before. In such cases I also do local installs of the build tools as well. It's nightmarish. I don't envy you...

Hi, I'm not sure what each output comes from what. I will need more info to answer your question. Regards.

Hi I agree with you.

Hi, Can you send me your logs? Last time I tested mbart-50 training, 1024 was the maximum batch size I could train on with my 32 GB. Even then I...

A small edit: In your previous run there should be a folder with the suffix "_deploy". Set --tokenizer_name_or_path to this folder and you can resume training. I am also considering...

Hi, I just pushed some code a moment ago with some explanation in the commit which I am pasting here. Changes: 1. Split the use_official_pretrained flag into use_official_pretrained and use_official_pretrained_tokenizer...

Exactly! You got it! Hope it runs smoothly now.

I think I figured out why your model run crashes. The part you commented out contains del checkpoint_dict Actually this dict maintains a copy of the model parameters and this...

Hi, I think you are not using the version of transformers that I have provided with the toolkit. Either that or your sentencepiece version is not the one in the...