llm.c
llm.c copied to clipboard
Add DockerFile
This Dockerfile sets up environment to start the training process.
You still need to download and run
python dev/data/fineweb.py --version 10B
You can build the dockerfile using
docker build -t llmc .
and run it using
docker run -it --ulimit memlock=-1:-1 --ulimit stack=67108864:67108864 --shm-size 2g --gpus all llmc bash