data
data copied to clipboard
Adding Progress Bar to Remote DataPipes
🚀 The feature
Add a progress bar to remote DataPipes that will be shown in the terminal to display the status of the operation. We can potentially use tqdm
or rich
.
Previous discussion comes from this comment by @pmeier .
Motivation, pitch
For DataPipes that download data from a remote server, it is useful to have a progress bar to show the download progress so that the users can know if the process is working and what the estimated remaining time is. Relevant DataPipes may be HttpReader
, GDriveReader
, iopath
, fsspec
and S3
DataPipes.
There may be usages for other types of DataPipes as well.
Alternatives
There are many ways to display the status of the operations to users. Feel free to suggest other ideas.
Additional context
No response