dstack
dstack copied to clipboard
dstack is an open-source alternative to Kubernetes, designed to simplify development, training, and deployment of AI across any cloud or on-prem. It supports NVIDIA, AMD, and TPU.
### Problem TLS certificates are never deleted on gateways. Even if a certificate was issued for a service that is no longer running and may never run again, the certificate...
### Problem Some instance types aren't repo or project specific ("cheap 24Gb GPU" is something that any project might find useful for example). Being able to have a global profile...
### Problem Currently, when we start a run an instance is created and when we stop the instance gets terminated/destroyed without saving any state to disk. I want the instance...
### Problem In case of a problem with the dstack server, it's hard to investigate without debug logs, which are not always turned on. Re-running the server with a debug...
### Problem TPUs are widely available, having TPU support would be really useful. ### Solution Collaborate with Google platform for adding TPUs. ### Benefit Large scale, energy efficient solutions for...
To use spot instances with an AWS account, the account needs to have the corresponding service-linked role created (`AWSServiceRoleForEC2Spot`). If this role is not created, AWS will throw the following...