Ritesh H Shukla
Ritesh H Shukla
Code in CSI branch
Yes
Child of https://github.com/oneconcern/datamon/issues/26
Not needed for MVP but we have to design this bit sooner than later. The implementation can come somewhere before Beta
ref: https://github.com/karrick/godirwalk
This will also eliminate the max CAFS file size limitation for uploads. Not applicable to downloads.
Other suggestions as improvements. - [ ] Resumable downloads - [ ] Retry in the CLI path
The choice to include labels when listing bundles should be optional. There is a performance implication for it. The current model in place allows us to have confidence that a...
[file tracker](https://github.com/oneconcern/datamon/tree/master/pkg/filetracker) implements the core of the logic needed but he code around it needs completion. Also, the metadata representation in memory needs to be reflect this ability.
https://github.com/oneconcern/datamon/pull/99 and other PRs cover parallelize reads. Without having a clear ask for how to better represent progress, the current CLI works file as the blobs are uploaded and logged...