data icon indicating copy to clipboard operation
data copied to clipboard

Adding Progress Bar to Remote DataPipes

Open NivekT opened this issue 2 years ago • 3 comments

🚀 The feature

Add a progress bar to remote DataPipes that will be shown in the terminal to display the status of the operation. We can potentially use tqdm or rich.

Previous discussion comes from this comment by @pmeier .

Motivation, pitch

For DataPipes that download data from a remote server, it is useful to have a progress bar to show the download progress so that the users can know if the process is working and what the estimated remaining time is. Relevant DataPipes may be HttpReader, GDriveReader, iopath, fsspec and S3 DataPipes.

There may be usages for other types of DataPipes as well.

Alternatives

There are many ways to display the status of the operations to users. Feel free to suggest other ideas.

Additional context

No response

NivekT avatar May 24 '22 20:05 NivekT