Enabling simpler flow of information from the `Tokenizer` to the `trainer`.

Open Narsil opened this issue 3 years ago • 1 comments

Currently, there are still quite a bit of issues when information is set on the Tokenizer and the trainer is not picking up those elements leading to errors/incomprehensions:

https://github.com/huggingface/tokenizers/issues/876

Mar 01 '22 09:03 Narsil

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

Feb 22 '24 01:02 github-actions[bot]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

Jul 07 '24 01:07 github-actions[bot]