dstack
dstack copied to clipboard
dstack is an open-source alternative to Kubernetes, designed to simplify development, training, and deployment of AI across any cloud or on-prem. It supports NVIDIA, AMD, and TPU.
### Steps to reproduce 1. Create an ssh fleet on instances without Docker installed. 2. Fleet hangs in status `pending`. ### Actual behaviour The shim fails with the panic: ```...
### Steps to reproduce 1. Clone repo: https://github.com/mobiusml/aana_sdk.git 2. Install dstack: `pip install dstack` 3. Configure dstack: ```bash dstack config --url https://sky.dstack.ai --project --token ``` 4. (Optional) Modify `tests.dstack.yml` to...
### Problem for the purpose of organizing on-premise servers, it wouldn't be necessary to download heavy files such as (~GBs of model weights) every time when a `run` is provisioned....
### Steps to reproduce Run a model with OpenAI interface. ```shell > cat .dstack.yml type: service image: ollama/ollama commands: - ollama serve & - sleep 3 - ollama pull llama3.1...
Example: https://developer.hashicorp.com/terraform/tutorials/kubernetes/kubernetes-provider Using terraform will allow to manage multiple configurations at once and reuse the terraform ecosystem.
Allow to create volumes associated with each host while configuring an SSH fleet. This way each volume is associated with a particular instance and later can be re-used. Optional: Automatically...