Problem when asking something to the AI

Open SimoGiuffrida opened this issue 2 years ago • 4 comments

Hello, i get this problem once i ask something: Can someone help me?

Mar 21 '23 10:03 SimoGiuffrida

Your UI is showing no models. I think you need to install the model first using "npx dalai llama install 7B".

Mar 21 '23 10:03 Nabeelhasan

Your UI is showing no models. I think you need to install the model first using "npx dalai llama install 7B".

I have the 7B model installed tho

Mar 21 '23 10:03 SimoGiuffrida

My friend is having the same problem (accessing the WSL port 3000 through WSL's port forwarding from the Windows host side).

Mar 22 '23 09:03 aki-k

I have the 7B model installed tho

No you don't. It's not quantized. You only have the consolidated file. Download the prequantized version from here https://huggingface.co/pi3141/llama-7B-ggml

Put the downloaded bin file into C:\users\simog\dalai\llama\models\7B

Mar 22 '23 15:03 ItsPi3141