dstack
dstack copied to clipboard
dstackai
An open-source container orchestration engine for running AI workloads in any cloud or data center. https://discord.gg/u8SmfwPpMd
### Steps to reproduce This PR [1119](https://github.com/dstackai/dstack/pull/1119) provides spot provisioning for Runpod. Provisioning with `dstack run . -b runpod --gpu 1 --spot --retry` would re-submit the run if pod is...
### Problem Both providers currently do not support pulling docker images from private docker registry. ### Solution Add registry auth: - [ ] RunPod - [ ] VastAI ### Workaround...
In that case, no configuration will work if the Docker image's default entrypoint isn't `/bin/bash` or `/bin/sh`.
Some models used for run configurations have duplicates. See `GPUSpec` and `GPUSpecSchema`, `DiskSpec` and `DiskSpecSchema`, etc. The `*Schema` models are needed to generate a more permissive JSON schema, see [this...
### Problem Runpod offers two types of cloud [Secure, Community]. Community cloud offers machines in cheaper price than Secure cloud. Currently, gpuhunt aggregates and lists offers from both Secure and...
Currently RunConfigurations are documented both via docstrings and via Annotated description. The docstrings are used to generate Python API reference, and the annotations are used to generate .dstack.yml reference. The...
### Current If a newer dstack version is available, CLI shows a message about it when running `dstack server`. The message is the same for stable and pre-release versions. ```...
Once the RunPod was added, we observed a few of issues with its functionality. 1. The availability information is accurate at the moment the API call is made. 2. The...
Add support for Oracle Cloud Infrastructure. The main priority is on-demand GPU instances. Support for other types of instances may be added later. Implementation plan: - [x] backend configuration -...