rethinkdb-python icon indicating copy to clipboard operation
rethinkdb-python copied to clipboard

add rate limiting to export and dump commands

Open larkost opened this issue 9 years ago • 0 comments

When export or dump run they can overwhelm some clusters, slowing down normal traffic. An ultimate solution would be to de-prioritize traffic going to the backup tools, but that would be a lot of work.

A much more approachable solution would be to put rate limiting into the export command (which is used by dump). This would be per-concurrent table, and would have to be something simplistic like number-of-records-per-second, but would probably be the biggest bang-for-the-buck.

larkost avatar Jul 16 '16 02:07 larkost