dstack
dstack copied to clipboard
dstackai
dstack is an open-source alternative to Kubernetes, designed to simplify development, training, and deployment of AI across any cloud or on-prem. It supports NVIDIA, AMD, and TPU.
### Steps to reproduce 1. Create a gateway 2. Run one or several services behind the gateway 3. Reboot the instance the gateway is running on, e.g. via its cloud...
### Problem If the user omits the [`python`](https://dstack.ai/docs/reference/dstack.yml/dev-environment/#python-version) property in the run configuration, `dstack` is supposed to use the Python version installed in the user's environment. This allows `dstack` environments...
Use cases: 1. Use the endpoint to implement custom auto-scaling logic (#1762) 2. Export metrics to Prometheus/Grafana
### Problem Currently, if you'd like to run services on RunPod, you need to create a gateway. Gateways are only supported with AWS, GCP, or Azure, or you must use...
Sentry will help monitor `dstack-gateway` for errors and performance issues in `dstack` Sky. OSS and Enterprise users may also opt in to using Sentry for their gateways.
`dstack` docs often contain broken links that hurt the user experience. To prevent broken links, these measures are suggested: - Build docs in strict mode (`mkdocs build -s`) so that...