Anthony Goddard
Anthony Goddard
@skylarmt @nyurik is this resolved now? I'm seeing each daily planet update take around 45min on a fairly basic system (running on master) ``` [Feb 10 21:38:52] [INFO] [diff] Processing...
@frodrigo actually is it possible that this will be very different based on whether `import-sql` was run before `update-osm`? I think that maybe once the indexes etc are added, the...
@frodrigo given the significant difference between running `update-osm` before and after `import-sql`, would there be a downside to the following workflow? 1. Server A: `import-osm` 2. Server A: `update-osm` to...
I think I see this same issue where replays stop appearing after some time - restarting all containers fixes it - after the restart, replays which were previously missing now...
@hubertdeng123 my apologies, I mistyped that - I have updated my comment now. In that sentence I said “containers” were missing when I meant “replays” were missing. Now that I...
I don't have a lot to add, except that selectively restarting zookeeper, clickhouse didn't fix it, but a restart of all containers again fixed it. This time my most recent...
@bmckerry when the issue occurs, the most recent Kafka container log (issue occurred around the same time as this log too) is a log cleaner message with additional detail (shown...
@hubertdeng123 super chill during normal operation. load avg ~0.5, host using 8 of 32GB ram (I'll see if I can check how much docker/sentry is using), but it doesn't seem...
@hubertdeng123 it's back in the stale replay state, CPU, load, memory are all fine - all containers are up and no crashes. I can leave it in this state for...
thanks @fpotter I just tested restarting `snuba-replays-consumer` and I can confirm that fixes it for me too. Judging by the logs from that container, it's showing errors which seem to...