dstack
dstack copied to clipboard
dstackai
dstack is an open-source alternative to Kubernetes, designed to simplify development, training, and deployment of AI across any cloud or on-prem. It supports NVIDIA, AMD, and TPU.
### Problem If pre-commit is not installed on the developer's system, code changes with linter errors can end up being committed to git. The CI workflow should detect such errors,...
### Steps to reproduce Apply the configuration: ```yaml # dev-environment.dstack.yml type: dev-environment name: dev-environment ide: vscode env: - RUN_VAR=1 ``` 1. Log in and run command: ``` $ ssh dev-environment...
### Steps to reproduce Apply the configuration: ```yaml type: dev-environment ide: vscode image: nvcr.io/nvidia/tritonserver:25.06-py3 setup: - pip install uv resources: gpu: L4 backends: [aws] inactivity_duration: 1h ``` ### Actual behaviour...
In container-based backends, we have to implement backend-specific logic to detect if the pod is assigned to an instance which means its successfully provisioned: 1. In `runpod` and `vastai` we...
**1. Run configuration type:** - [ ] Consider showing some minor properties only if `--verbose` is set, e.g. `project`, `user` - [ ] Consider not showing configuration properties if they're...
Currently the docs miss the public projects feature: https://dstack.ai/docs/concepts/projects/
### Steps to reproduce 1. Create a gateway resource. 2. Wait for the gateway EC2 instance to finish launch sequence. 3. Delete the gateway EC2 instance on AWS. 4. Try...
### Problem Time To First Token (TTFT) and Inter-Token Latency (ITL) directly reflect user experience: **TTFT:** Time until the first token appears (responsiveness) **ITL:** Time between subsequent tokens (generation speed)...
### Problem The UX is poor when the user applies a run or fleet configuration, some offers fail, and `dstack` tries other offers. - It can remain unnoticed that `dstack`...
### Problem It is not always clear which fleet configuration properties are relevant for cloud fleets and which are relevant for SSH fleets. This leads users to compose configurations with...