How can we output the progress bars within a jupyter notebook?

[ohmeow]

... in particular when we run tokenizer.train(...)

[n1t0]

Indeed, this is a known limitation of the library we use to show progress. Unfortunately, it won't show anything if not attached to a "real" terminal, so it does not work in Notebooks.

[github-actions[bot]]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

[n0kovo]

Indeed, this is a known limitation of the library we use to show progress

So uh, could this "known limitation" maybe be considered, you know, an... issue? Considering that a pretty huge chunk of tokenizers users primarily use Jupyter/Colab etc.? Just thinking out loud 🤷