deep-learning-pytorch-huggingface icon indicating copy to clipboard operation
deep-learning-pytorch-huggingface copied to clipboard
verified publisher icon philschmid

Add tokenizer to Trainer object

Open mrm8488 opened this issue 3 years ago • 1 comments

This way, It will be pushed too on trainer.push_to_hub()

mrm8488 avatar Dec 28 '22 13:12 mrm8488

I kept its purpose separate if you want to "decouple" the training and processing parts.

philschmid avatar Dec 29 '22 10:12 philschmid