datamon icon indicating copy to clipboard operation
datamon copied to clipboard

CAFS friendly local mutable fuse mount

Open kerneltime opened this issue 6 years ago • 3 comments

For now each new file is mapped to a new temp file that mirrors the logical fuse file hosting all IO. This needs to be replaced with a CAFS friendly staging area that chunks up files into leaf size for a given bundle config and on commit moves the files to the local blob cache to avoid extra local IO and easier parallel upload of blobs.

kerneltime avatar Feb 05 '19 21:02 kerneltime

Child of https://github.com/oneconcern/datamon/issues/26

kerneltime avatar May 10 '19 20:05 kerneltime

My take on this would be a local badgerdb acting a the local key-oriented staging

fredbi avatar Feb 28 '20 11:02 fredbi

there is also filetracker to layer in-memory caching

ransomw1c avatar Mar 02 '20 18:03 ransomw1c