dolt admin archive

[macneale4]

This hidden admin command will convert the table files in oldgen into archive files, then update the manifest so that you can run queries against the archive for performance testing. Currently we assume that dolt gc has been run immediately prior to using this command.

After the build is complete, we lookup every chunk in the archive using the index of the originating table file. We then verify each chunk's key checks out. If this verification fails, exit status 1.

Lot of rough edges still:

• Currently no feedback as the build progresses. This is annoying because it can take a fair amount of time
• ChunkSource interface is single threaded, so getMany and hasMany are not going to perform well.
• Lacking checks to ensure that the server isn't running and we have the LOCK on oldgen.
• No bats tests, and this is kind of a temporary thing. There are go tests on key bits.