llama
llama copied to clipboard
Inference code for Llama models
I keep running into this error. I realise that there are certain characters that can't be encoded properly. I did some digging around and tried changing the codec but it...
I accidentally deleted the tokenizer.model when I started download.sh. When I repeated the download, it had already been 403 forbidden, so it could not be downloaded (maybe the download link...
Got the following error when executing: `torchrun --nproc_per_node 1 example.py --ckpt_dir models/7B --tokenizer_path models/tokenizer.model` ![image](https://user-images.githubusercontent.com/13464974/222400735-2a506fa7-a6aa-49ed-9960-b1891b814420.png) additional info: cuda: 11.4 GPU: NVIDIA GeForce 3090 torch 1.12.1 Ubuntu 20.04.2 LTS Anyone knows...
im stuck at downloading metadata for 30 mins now
Hello, I got the 7B model to work on a [Shadow PC](https://shadow.tech/) with just **12GB RAM** and **16GB** P5000 GPU 😲. (This is equivalent to about a Nvidia 1080) If...
Hello all, I'm trying to use the 7B model on a machine with two Nvidia 3090s, but am running out of Vram. `$ torchrun --nproc_per_node 1 example2.py --ckpt_dir ../llamafiles/7B --tokenizer_path...
The torrent seed is extremely slow this should definitely help out