Matt O'Neill issues

Repositories
Issues
Comments

Results 2 issues of


                                            Matt O'Neill

Hot start a new node when a percentage of max_concurrency is reached

Currently FLAME will only start a new node when the maximum concurrency is reached which can lead to cold starts during heavy load. Adding a new parameter for "spinup_at_percentage" and...

Add hotstart_threshold to flame.pool

upon the concurrency exceeding the threshold a new node is added to the pool. This allows for pre-empting load and is intended for usecases where a cold-start is costly, such...