dalai icon indicating copy to clipboard operation
dalai copied to clipboard

Where do you put the models? (I already have my models, I don't need to download them again.)

Open mapleroyal opened this issue 1 year ago • 3 comments

Is there a reason this isn't in the instructions/readme? Am I missing something?

mapleroyal avatar Mar 22 '23 20:03 mapleroyal

~/dalai/alpaca/models/13B/ggml-model-q4_0.bin

Found out by trying to install a model. It started downloading, then I canceled, then I overwrote it with my previously downloaded model. Guess you could probably use a symlink too if you wanted.

haroldthegray avatar Mar 22 '23 22:03 haroldthegray

https://i.imgur.com/7M0LgBU.png

The model is right there. I'm using llama not alpaca. The model is also in my regular llama.cpp directory, and I read that dalai can see it in both places, yet it's not seeing it at all in either. What am I doing wrong?

mapleroyal avatar Mar 23 '23 04:03 mapleroyal

For me, both models can be found in the cmd when running: npx dalai serve and going to the localhost. But only the alpaca models show up in the webUI

sownheard avatar Mar 25 '23 15:03 sownheard