influx-cli icon indicating copy to clipboard operation
influx-cli copied to clipboard

Speed up backup process by downloading multiple Shard Groups in parallel

Open TwentyFiveSoftware opened this issue 3 years ago • 0 comments

Currently, the backup process is pretty slow, because it only downloads one shard at a time from the Influx API and stores it on the file system. This process tends to be very slow on larger databases, as it doesn't take advantage of large IO capacity which could speed up this process tremendously. This could be improved by downloading multiple shard groups in parallel.

TwentyFiveSoftware avatar Mar 08 '22 16:03 TwentyFiveSoftware