venice icon indicating copy to clipboard operation
venice copied to clipboard

[server] Added a throttler for AAWC workload of leader replica

Open gaojieliu opened this issue 6 months ago • 0 comments

Summary, imperative, start upper case, don't end with a period

We know AA/WC workload is expensive and in the past, we were trying to limit the consumer pool for AA/WC leader to control the resource usage, but sometimes, it is not very accurate. This code change introduces a new throttler for Leader AA/WC workload, and it will only take effect when the dedicated consumer pool for AA/WC leader feature is enabled. New config: server.aa.wc.leader.quota.records.per.second : default (-1)

How was this PR tested?

CI

Does this PR introduce any user-facing changes?

  • [X] No. You can skip the rest of this section.
  • [ ] Yes. Make sure to explain your proposed changes and call out the behavior change.

gaojieliu avatar Aug 08 '24 16:08 gaojieliu