MySQL: --single-transaction flag, chunking and binlog

[RoxasShadow]

falcolas:

The mysql driver needs additional work. In particular, it needs a '--single-transaction' flag, or a global lock, to ensure that the dump is consistent - particularly if you want to dump multiple databases concurrently.

Doing one dump per table with chunking (each file has N rows) would help with both speed and disk sizes of backups by allowing S3 or some other program to implement de-duplication between incremental backups.

It also wouldn't hurt to capture the binlog position, if available, to enable point in time recovery.

Have a look at mydumper for an idea of how another tool implemented these:

https://launchpad.net/mydumper