pg_probackup icon indicating copy to clipboard operation
pg_probackup copied to clipboard

Published 20 hours ago • verified publisher icon postgrespro

Dividing WAL segments by directories

Open stratumO opened this issue 5 years ago • 3 comments

Hi! I suggest dividing WALs from the archive into different directories, because when writing a large number of segments to the network directory (30-40 thousand per day, NFS for example) for several weeks, there are problems with the availability of the directory.

You can divide by dates hours or segment names (for example, as in barman) Thanks!

stratumO avatar Jun 30 '20 06:06 stratumO

Hello! Looks like a must have feature and, since we must be able to determine the segment location for WAL parsing, the barman way of grouping them per log segment (one directory for 256 segments) is a good way to do it. Thank you for the feedback!

gsmolk avatar Jun 30 '20 07:06 gsmolk

I'am usin NFS storage also. It's good to have something like /backup/instance/wal/YY-MM-DD/ subdirs

beremour avatar Aug 31 '20 13:08 beremour

Hi! We prepare this enhancement in the 2.5.7 release https://github.com/postgrespro/pg_probackup/pull/500

Burus avatar Jul 29 '22 14:07 Burus