sysadmin
sysadmin copied to clipboard
System administration tools
Impact: 8h 50m downtime of b.echo.th.ooni.io test helper (?) Detection: CPUHigh alert with expected 8h delay Timeline UTC: 17 Nov 07:30 CPU spikes to 100%, thats _`accept()` vs. EMFILE_ busy...
Impact: **TBD** (AFAIK clients should use another test helper if one of them is down, but it may be not the case). Detection: repeated email alert Timeline UTC: 00:00 four...
WIP toward unified monitoring and log aggregation via datadog Related to: https://github.com/ooni/backend/issues/785
Fix resolution, logging, ipaddr anonimization
They are not online anymore. Related to: https://gitlab.torproject.org/tpo/anti-censorship/team/-/issues/98
Deploying the new oonidata host which replaces shinri