oban icon indicating copy to clipboard operation
oban copied to clipboard

Oban Met - Configure Reporter Interval

Open thiagopromano opened this issue 7 months ago • 2 comments

Is your feature request related to a problem? Please describe.

Our system executes millions of jobs every day, to aid that, we use DynamicPartitioner and ObanWeb.

During moments of high DB stress, one query that pops up using a large share of the total "Query Time" is the Oban.Met.Reporter query, counting the number of jobs in several queue states.

Although it has a built-in backoff considering the number of rows in each queue state, it is still too expensive and executed too often for our use case, especially during high-stress times.

Describe the Solution You'd Like

There are a few possible solutions, one of which is to allow us to configure the interval or backoff parameters.

The other option would be to allow disabling the Reporter entirely, loading the required data "on demand" when the Oban Web requires it (or never at all).

thiagopromano avatar Jul 15 '24 11:07 thiagopromano