Stack Overflow under Many requests / high pressure load

[mrgrayhat]

Hi. The problem is when the number of requests is too large, for example several thousand requests. As a result, the program encounters a stack overflow exception and thread pool errors. I was testing my program with bombardier when I encountered this problem. While many requests are logged at short intervals. (From a few thousand to ten thousand and more, with about 100 connections).

There is no problem with sinks-console, but I have such a problem with async sink. Tell me If you need more details, I will send it.

With the best wishes. Thanks

[nblumhardt]

Hi! How are you configuring the sink? Do you have bufferSize and blockWhenFull set? The console sink provides backpressure by default, while the async wrapper does not, so it's also possible the lack of the console sink's throttling behavior is exposing other issues on the app-side, e.g. thread pool exhaustion. HTH!