self-hosted icon indicating copy to clipboard operation
self-hosted copied to clipboard

snuba keep crashing / restarting without any error message

Open gizmo84 opened this issue 10 months ago • 9 comments

Self-Hosted Version

24.4.1 (but since 24.3.0)

CPU Architecture

x86_64

Docker Version

25.0.5

Docker Compose Version

2.26.1

Steps to Reproduce

Start Sentry, generate issue. No issues are displayed in the gui.

Expected Result

See isssues again in the GUI

Actual Result

Initializing Snuba... Snuba initialization took 8.68588224000996s Initializing Snuba...

Event ID

No response

gizmo84 avatar Apr 18 '24 21:04 gizmo84

We started a fresh Install on an other server, same result: even with a basic setup, Sentry doesn't display any "Issues" and has the same Problem with Snuba as our old instance:

Initializing Snuba... Snuba initialization took 8.68588224000996s Initializing Snuba... ...

gizmo84 avatar Apr 19 '24 06:04 gizmo84

My first guess here would be a memory issue. Can you check the memory usage on this container, and the system asa whole, relative to how much you have available?

azaslavsky avatar Apr 22 '24 18:04 azaslavsky

@azaslavsky I have 16 GB RAM on both VMs and it was working smoothly until 24.4.0

gizmo84 avatar Apr 23 '24 09:04 gizmo84

I don't doubt that your setup is sufficient, but if the issue is related to memory consumption on our end due to something we snuck into the 24.4.0 release, it would be a helpful data point to know.

azaslavsky avatar Apr 23 '24 15:04 azaslavsky

So I increased the RAM from 16 Gb to 24 Gb and the number of core on the machine. Snuba is still crashing.

I noticed one error in the log just befor the next "Initializing Snuba..."

{"timestamp":"2024-04-24T14:14:30.849469Z","level":"ERROR","fields":{"error":"the strategy errored"},"target":"rust_snuba::consumer"}

gizmo84 avatar Apr 24 '24 15:04 gizmo84

Can you try the advice posted here?

azaslavsky avatar Apr 24 '24 17:04 azaslavsky

Yes!! Sentry is working again for me. I replaced all occurrences of rust-consumer in docker-compose.yml file to just consumer.

Should I keep this issue open until it is fixed ?

gizmo84 avatar Apr 25 '24 07:04 gizmo84

cc @volokluev. We'll keep it open for now.

azaslavsky avatar Apr 25 '24 16:04 azaslavsky

I just upgraded from 24.5.0 to 24.8.0 and this is still an issue. Replaced again all occurrences of rust-consumer in docker-compose.yml file to just consumer...

gizmo84 avatar Sep 13 '24 07:09 gizmo84