Bulk add directories for initial sync

Open TheDiscordian opened this issue 4 years ago • 1 comments

As directory size grows, calls to MFS like files/cp, files/mkdir, and files/rm get slower and slower. For initial sync at least, adding directories, we could add all the files at once, with the entire directory tree. Then a single files/cp could copy the tree into MFS, solving this problem for initial sync.

Could still be a bit slow for anything other than initial-sync, but I think initial sync is where this will impact the most.

Mar 22 '21 19:03 TheDiscordian

files/cp doesn't seem too slow. Will need more testing, but with #28 and #29 tackled, this issue doesn't impact nearly as much.

Mar 23 '21 01:03 TheDiscordian