llama

llama copied to clipboard

Funny or Interesting results.

7

Post your funny or interesting results of the language model here. 😁

pauldog

Neural Network Weights are not Copyrightable! 🥳🎉

4

Good news people. Neural Network Weights are not copyrightable by US law. `"that material from a non-human entity is not copyrightable"` Also, since the model itself is open-source, this means...

ghost

PaddlePaddle implementation of LLaMA

1

I have reimplemented llama with the paddlepaddle framework and provided an example of running 7b using aistudio free computing power, feel free to test and suggest improvements. repo: [ppllama](https://github.com/MiuGod0126/ppllama)

jiaohuix

Suggestions on running LLAMA with limited resources?

13

Being a grad student, I have limited free personal resources such as Google Colab available. But in Google Colab, when I try running the `example.py` script (after downloading weights), I...

ashryaagr

AttributeError: 'NoneType' object has no attribute 'get' when running torchrun

4

I encountered an error when running torchrun command on my system with the following traceback: ``` Traceback (most recent call last): File "/mnt/f/projects/python/git/llama/venv/bin/torchrun", line 8, in sys.exit(main()) ^^^^^^ File "/mnt/f/projects/python/git/llama/venv/lib/python3.11/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py",...

aminechraibi

Does llama only use decoders? Why don't you use a more efficient method?

1

Thanks for sharing this really good material. I have a lot of questions. First, I'd like to say that I hope you ignore much of the mockery. Everyone, including me,...

gyunggyung

Seed LLAMA weights

2

Can someone please seed the llama weights at magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA&tr=udp%3a%2f%2ftracker.opentrackr.org%3a1337%2fannounce Or make them availabe at google drive? There are 0 seeders not sure how long they will stay

Jainam2130

Failure on A100 32GB

11

Hi, I've been trying to run the example inference using the 7B model weights, but I get: torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 86.00 MiB (GPU 0; 39.59...

vincenzoml

Running model parallel Inference

1

I am trying to run inference on the 7B parameter model on 4x2080Ti, the default script to run inference gives me a CUDA OOM error. is there a way to...

SupreethRao99

How to run 13B model on 4*16G V100？

2

RuntimeError: CUDA out of memory. Tried to allocate 160.00 MiB (GPU 0; 15.78 GiB total capacity; 14.26 GiB already allocated; 121.19 MiB free; 14.69 GiB reserved in total by PyTorch)...

qwer10