mapleroyal
mapleroyal
Linux. Please update if you find out! 100% of all attempts to use dalai have been thwarted on 2 separate linux machines. No matter what I do, it either randomly...
> Ok so this many only work for @taaalha. or anyone else on windows But go into \dalai\llama\build\bin\Release and copy llama.exe to dalai\llama\build\Release and rename it main.exe. Then turn the...
More issues where people are complaining of no output: https://github.com/cocktailpeanut/dalai/issues/281 https://github.com/cocktailpeanut/dalai/issues/221
FIGURED IT OUT!!! Apparently if you have your own models and don't need dalai to download them for you, then `npx dalai serve` does not actually install the rest of...
> Hi mapleroyal, when you said: "delete everything except ..." what do you mean exactly. I have only the folder 7B and ggml-vocab.bin. So I don't know what I have...
Do you guys have folders at /home/username/dalai/llama/models or /home/username/dalai/alpaca/models Apparently when it's working, people have a full blown install in those directories. Mine don't even HAVE those directories unless I...
I don't know. I didn't have those folders, so I ran the stupid install command even though I already have the models, and it started building that directory out. I...
I would highly recommend getting the official models, however you can, then checking their b3sums, and doing the converting and quantizing yourself. Unlike this project, the llama.cpp one's instructions actually...
https://i.imgur.com/7M0LgBU.png The model is right there. I'm using llama not alpaca. The model is also in my regular llama.cpp directory, and I read that dalai can see it in both...
OK I worked it out: The models need to be compatible models. I don't know how it determines it, but that's that. I had struggled so much and tried so...