Docker image to deploy a llama-cpp container with conda-ready environments

Requirements

1. You have gnu/linux
2. You have docker engine installed
3. You have an NVIDIA gpu

Preliminary steps

Please, install the NVIDIA Container Toolkit following this guide.

To build the container

chmod +x build start stop

./build

To start the container

./start

To connect locally

docker container attach llama-cpp-container

To connect remotly thorugh SSH

ssh 

To stop the container running

./stop