9876691
9876691
I can provide some feedback. Go to https://www.deepspeed.ai/ it's just a list of news. It doesn't say what the project does or how to work with it. Then if I...
@danzeeeman You can take install CUDA 12.1 in a Dockerfile as follows ```Dockerfile # Install Nvidia Cuda Toolkit # Taken from https://github.com/devcontainers/features/tree/main/src/nvidia-cuda # Add NVIDIA's package repository to apt so...
Are you using `--gpus all` in your docker command?
> I tried to install nvidia drivers but couldn't. Can you tell me how can i resolve this? Do you mean the nvidia container runtime? https://github.com/NVIDIA/nvidia-container-runtime/ AFAIK you'll need that.
No, the container runtime automagically puts the nvidia drivers into what ever image you are running when it sees the `--gpu all`.
So now I get an error when doing pip install. ```sh (llmfoundry-venv) root@cd2c34937d93:/home/mosaicml/llm-foundry# pip install -e ".[gpu]" Obtaining file:///home/mosaicml/llm-foundry Installing build dependencies ... done Checking if build backend supports build_editable...
> another would be the ability to define Web Components in Kobold to use them outside of Kobold. That was probably the OP's intention. There's some background on web components...
Hi, the documentation for email hasn't been updated since we moved to a Kubernetes based install. I'll work on it over the weekend and let you know.
Documentation has been updated to use a K8s secret.
@rpaGuyai Thanks, will test our side. We run on Linux using K3s but hopefully we can reproduce this.