Add own directory traverser.

[dpc]

While I personally enjoy feeding rdedup with rdup archive on standard input, having own directory traverser that utilizes mmap, could make things much faster.

[phillipCouto]

I did a quick scan of cargo and found a tar crate that will allow for the use of standard format. I am probably going to make a backup manager tool that will leverage both the tar format plus rdedup-lib, time permitting =)

I want to replace my use of time machine with a more portable format.

[dpc]

👍

[phillipCouto]

So for this feature would we build it into the rdedup bin or separate project from rdedup?

[dpc]

It should be a separate crate, using rdedup-lib, it could be hosted in the same repo though, for convenience.

[Ralith]

I'm currently experimenting with a prototype traverser at Ralith/rackup. In the interest of enabling random directory traversal of backed-up data with minimal IO overhead, I'm employing a custom metadata format rather than using tar.

[geek-merlin]

Note: For some of my use cases it's essential to store xattributes of files (like tar does with some suitable options). Can the mentioned traversers do this too?

[dpc]

The traverser can implement anything it wants. Rest of rdedup only cares about storing and restoring the sequence of bytes it gives it.