Linas Valiukas

Initial backup to B2 exited because the PostgreSQL container went away (got killed by someone / something): ``` INFO: 2021/11/02 06:54:03.685946 Finished writing part 24382. INFO: 2021/11/02 06:54:03.686024 Starting part...

Started a test restore on EC2 to find out how much time it would take us to restore the backup if we ever needed to do it. Should run for...

`postgresql-server` service got killed a few more times when attempting to do a full backup. Even though there are no signs (that I could find) that it has OOMed, I've...

Initial full backup restore (without WALs) from S3 took 4636 minutes (3,2 days) on `c6g.2xlarge` (8 vCPUs, 16 GB of RAM). Restore would have worked considerably faster on an instance...

> what do you think is a sensible upper bound for storage_opt? Dunno, as I don't really know what does it exactly limit :) Is it a cap on container...

By spidering you refer to `topics-*` apps?

Just to reiterate, this is "someday / nice to have" task. Some notes: * GitHub Workflows support scheduled jobs: https://docs.github.com/en/actions/reference/events-that-trigger-workflows#scheduled-events * We're supposedly [limited to 2000 Action minutes/month](https://github.com/organizations/mediacloud/settings/billinghttps://github.com/organizations/mediacloud/settings/billing) but I...

Moved the second complaint to #729.

Prep: ```python3 >>> import mediacloud.api, json, datetime as dt >>> import pprint >>> pp = pprint.PrettyPrinter(indent=4) >>> mc = mediacloud.api.MediaCloud('YOUR_KEY') >>> tag_sets_id = mediacloud.tags.TAG_SET_NYT_THEMES_VERSION >>> q = '*' >>> fq...

I think this `natatime()` call could be the one to blame, but I can't figure out how: https://github.com/mediacloud/backend/blob/12a0c0e896bb6979469248d43f4a7f1ec23c3d8e/apps/webapp-api/src/perl/MediaWords/Controller/Api/V2/StoriesBase.pm#L279-L302