T.v.Dein comments

Results 76 comments of


                                            T.v.Dein

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

OK, I'll re-try. The problem with the logs is, that gist doesn't work for me, for some unknown reason.

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

Al right, I tried it again using the additional env vars. The behavior is the same, it misses a couple of parts (although it tries to fetch 'em) and it...

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

I've got some more data. Fortunately we operate our S3 ourselfes so I can access its logs. So, I ran the backup-fetch job again. This time parts parts 2-5 and...

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

Ok, so I created a pod with the latest master of wal-g and run the `backup-fetch` again. Nothing has changed, especially no additional output. The behavior is the same as...

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

Now it's getting interesting. As told, I sent a restore run into the background on friday using the latest wal-g (master) binary. This morning I determined to my surprise that...

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

Well, I get the idea. But there's one problem I don't understand: why does it work with the latest wal-g from master? If there's a network problem (and this is...

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

> Probably, network code of Aws Sdk changed. So the sdk fixed something which affects our S3 instance? Is there a way to find out what? > How did you...

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

Already did that, found nothing which sounds even remotely relevant.

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

Only latest works. The last previous release 2.0.0 from may doesn't.

backup-fetch misses a couple of part_* files and hangs at the end leading to corrupt pgdata

Update: the problem has not been caused by some S3 incompatibilities, but nginx settings on one of our S3 services: ``` proxy-body-size: 5G proxy-buffering: "on" ``` These have been set...