Pi
Pi
I understand the problem here. However, most of the time, the AI isn't used to generate code. And the AI often doesn't use linebreaks in strings in the code that...
Ok thanks for letting me know! I did not know that. I'll look into this and see what I can do.
Ok I'll work on it when I have time.
> Thank you! (also LLaMA added opencl support mabey look into that) Yep I'm working on it. I've been busy.
30B wouldn't run for me. It gave me an error saying that "tok_embeddings.weight" was the wrong size. It was something like 1664 when it should've been 6566 https://huggingface.co/Pi3141/alpaca-30B-ggml
Nvm I got it to work
> @ItsPi3141 what was the process that you did in order to get it to work? > @ItsPi3141 How did you got it to work? I'm not exactly using Alpaca.cpp....
> I've downloaded the 65b model onto a virtual environment but i'm not clear on the process. do you need to use Alpaca-LoRA before to fine tune it yourself or...
> https://github.com/shawwn/llama-dl That's LLaMA, not Alpaca.
> I just used the [instructions](https://github.com/antimatter15/alpaca.cpp#getting-started-30b) in the README which point to https://huggingface.co/Pi3141/alpaca-30B-ggml Hello! I made that alpaca 30B file, several people have used it and we all agree it...