kestra icon indicating copy to clipboard operation
kestra copied to clipboard

Feat/realtime trigger thread

Open loicmathieu opened this issue 4 months ago • 0 comments

This PR will dispatch the evaluation of realtime triggers to a virtual thread pool. To protect against too many triggers running, it can be limited when launching the Worker via --realtime-trigger-thread, when the pool is exhausted the realtime trigger fail. By default the pool is unbounded.

For monitoring purpose, 2 new metrics has been created:

  • worker.realtimetrigger.thread: the number of max threads to start for realtime triggers
  • worker.realtimetrigger.running: the number of realtime triggers running in this worker

loicmathieu avatar Oct 07 '24 10:10 loicmathieu