quickwit icon indicating copy to clipboard operation
quickwit copied to clipboard

Limit search requests concurrency

Open guilload opened this issue 1 year ago • 1 comments

Reject search requests with TooManyRequests when too many requests are in flight. This should be done at the root search level.

Screenshot 2024-11-21 at 3 42 30 PM

guilload avatar Nov 21 '24 20:11 guilload

I think we tend to use the following terminology:

  • concurrency limiting: process only n request at a time, and have the others wait in queue.
  • load shedding: returning an error right away if two many clients are waiting.

and we usually use them in combination.

Here I think @guilload wants load shedding. (we already have concurrency limiting, at least at the leaf search split level)

fulmicoton avatar Nov 22 '24 01:11 fulmicoton