temporal icon indicating copy to clipboard operation
temporal copied to clipboard

Add workers autoscaling through KEDA

Open mfateev opened this issue 6 years ago • 29 comments

https://github.com/kedacore/keda

mfateev avatar Nov 26 '19 22:11 mfateev

This sounds like a feature request to SDK?

yiminc avatar Oct 29 '22 17:10 yiminc

Just casting some light on this - we use KEDA with Postgres queries right now to scale our workers when there is more than a predefined number of tasks that our base node pool can handle.

At the moment it's 2 workers base and when there are more than 10 concurrent Workflows we spin up more servers, 5 concurrent Workflows per node. It's working well, but we're always a little worried that the schema will change and break everything. It would be great to abstract this out to a native integration with KEDA.

aakarim avatar Nov 01 '22 10:11 aakarim

I have this working within KEDA using the temporalClient's ListOpenWorkflow method and would love to chat to someone from the temporal maintainers about the best way to get this into the various repos and whether things make sense

ross-p-smith avatar Jun 08 '23 09:06 ross-p-smith

PR for the same https://github.com/kedacore/keda/pull/4863/files

febinct avatar Aug 08 '23 03:08 febinct

+1 would be a great feature to have. It's common to have specific workers (services) listening on specific task queues. Exposing the size of a given task queue would be a very precise autoscaling metric for those workers.

RonaldGalea avatar Nov 16 '23 08:11 RonaldGalea

My organization would like to see this, too.

sinkr avatar May 28 '24 17:05 sinkr

+1 This would be great to have

henrytseng avatar May 28 '24 17:05 henrytseng

My studio has just started testing Temporal and it would be great to have this feature.

justinfx avatar May 28 '24 19:05 justinfx