ClusterODM
ClusterODM copied to clipboard
Add support for autoscaling queue
Optional support for an autoscaling queue could allow users to queue tasks even if they hit account limit restrictions and provide a better flow.
This is exactly what i need. So the feature would do something like this:
- Check quotas for the asr provider before autoscaling.
- Push the task in a fifo queue if autoscaling will cause the provider account to met its limits.
- With each autoscaled node being removed, get next task from the queue and run 1. again.
Now that i think of it. If task files are externalized by ClusterODM instead of written on disk, and an external message queue is used, this could be easy to setup multiple clusterODMs on multiple asr providers accounts