llama icon indicating copy to clipboard operation
llama copied to clipboard

Inference code for Llama models

Results 412 llama issues
Sort by recently updated
recently updated
newest added

I keep running into this error. I realise that there are certain characters that can't be encoded properly. I did some digging around and tried changing the codec but it...

I accidentally deleted the tokenizer.model when I started download.sh. When I repeated the download, it had already been 403 forbidden, so it could not be downloaded (maybe the download link...

Added alternative torchrun through python.

CLA Signed

Got the following error when executing: `torchrun --nproc_per_node 1 example.py --ckpt_dir models/7B --tokenizer_path models/tokenizer.model` ![image](https://user-images.githubusercontent.com/13464974/222400735-2a506fa7-a6aa-49ed-9960-b1891b814420.png) additional info: cuda: 11.4 GPU: NVIDIA GeForce 3090 torch 1.12.1 Ubuntu 20.04.2 LTS Anyone knows...

im stuck at downloading metadata for 30 mins now

Hello, I got the 7B model to work on a [Shadow PC](https://shadow.tech/) with just **12GB RAM** and **16GB** P5000 GPU 😲. (This is equivalent to about a Nvidia 1080) If...

Hello all, I'm trying to use the 7B model on a machine with two Nvidia 3090s, but am running out of Vram. `$ torchrun --nproc_per_node 1 example2.py --ckpt_dir ../llamafiles/7B --tokenizer_path...

The torrent seed is extremely slow this should definitely help out

CLA Signed