David Eliahu

### Description The operator should timeout if a request is taking too long ### Notes * Probably want to use `context.Context`: create new `Context` for every request, and that context...

* Istio [rate limiting](https://istio.io/docs/tasks/policy-enforcement/rate-limiting/) * Can use elasticache? ([stack overflow](https://stackoverflow.com/questions/54769212/elasticache-redis-cluster-and-istio))

#### Description Part of the `cortex cluster up` process would be to upload the appropriate version of all Cortex images to the user's private ECR. It might be worth considering...

Help users debug issues when AWS could not provision instances

1

#### Description Sometimes the auto scaling group fails to spin up instances, e.g. if the user is at their instance limit (spot or on demand), or if AWS is out...

#### Description Currently requests are assigned to replicas at random. A smarter approach would be to assign based on least recently accessed (i.e. strict ordering), smallest queue size, or something...

#### Description Currently, `kubectl` is required to use a private docker registry (see here: https://docs.cortex.dev/guides/private-docker). #### Possible designs * Add a CLI command, e.g. `cortex cluster docker-login` * Add `docker_registry_username`...

Currently, if you install the CLI on a new machine and use different AWS credentials (with the `AdministratorAccess` IAM policy attached), running `cortex cluster` commands will not work. We link...

#### Description Add a command (e.g. `cortex cluster list`) which lists all cortex clusters. Include clusters that are running or are in an unexpected/incomplete states. If it's simple, there could...

When creating a cluster which uses 100% spot instances (with or without `on_demand_backup`) and has `min_instances` > 0, if spot instances are not available, cluster creation hangs in `eksctl`. The...