datamon icon indicating copy to clipboard operation
datamon copied to clipboard

Integrate progress bar and pipeline and parallelize reads

Open kerneltime opened this issue 5 years ago • 4 comments

Reading large files can lead to a poor user experience.

  1. Integrate with https://github.com/cheggaaa/pb to give better feedback
  2. look into parallelize CAFS reads and use of io.pipes

kerneltime avatar Mar 20 '19 18:03 kerneltime

Is this for bundle upload and download?

chandresh-pancholi avatar May 09 '19 22:05 chandresh-pancholi

it'd be good to have a proposal for user feedback (that is, to gauge intent of the changes) for large files. cafs parallelization is already done.

ransomw1c avatar May 09 '19 23:05 ransomw1c

https://github.com/oneconcern/datamon/pull/99 and other PRs cover parallelize reads. Without having a clear ask for how to better represent progress, the current CLI works file as the blobs are uploaded and logged in parallel.

kerneltime avatar May 10 '19 20:05 kerneltime

there's been an ask from Zhuo for a clearer way to indicate progress on uploads

ransomw1c avatar Sep 19 '19 23:09 ransomw1c