dalai This application cant response to me? It is waiting for much time. It is not working.

Now, Button name is go but in demo button name is autocomplete. I cant find solution for problem. I dont understand. Button is always turning but no response.

May 16 '23 13:05 Yaseminh

It didn't respond at all for me, but it did in a different project. How long did it take to respond? I hope we find a solution to the problem.

May 16 '23 17:05 Yaseminh

Same issue! LLaAM 7B responses to me normally. But Alpaca didn't response to me.

May 17 '23 02:05 Practicing7

What is your ram size and specs of your machine? I say it's enough if one of them works, but I couldn't get a response :(

May 17 '23 06:05 Yaseminh

My machine has a ram size of 128G, an A6000 GPU with 48G memory. OS: Ubuntu 22.04

May 17 '23 08:05 Practicing7

Same here, 32 G ram, Linux, alpaca 7B, no response at all. No error, seems stucked.

May 20 '23 12:05 PeterPanTheGenius

Same issue here.

May 26 '23 15:05 manel-moles

Works from the demo web ui but utilizing the api call demos only sends and processes the request; there's no response sent back to the client.

UPDATE: Wanted to include that I installed via npx dalai alpaca install instead of cloning, which works via the web ui.

May 26 '23 17:05 vulpcod3z

Also installed via npx dalai alpaca install 7B - same issue, no CPU usage, no response. Running via docker (actually podman, but it doesn't make a difference). I'll try llama 7B later.

Edit: works with Llama 7B - but I had to do the download manually, since it kinda stopped halfway through the download. No download-progress, but the estimated time roze.

Jun 24 '23 21:06 HidingCherry

same problem here alpaca 7B and 13B do not seem to provide any reply...anyone any idea? I'm on Ubuntu with 16GB RAM, no GPU. Thanks

Jul 25 '23 06:07 andreapago

same problem here alpaca 7B and 13B do not seem to provide any reply...anyone any idea? I'm on Ubuntu with 16GB RAM, no GPU. Thanks

Are you attempting to use the web interface or are you connecting via another application?

Jul 25 '23 15:07 vulpcod3z

Are you attempting to use the web interface or are you connecting via another application?

Just via the web interface. Thanks

Jul 25 '23 17:07 andreapago

I'd check your nodejs version first. Ubuntu 20.04 and earlier don't support >10.19 where dalai needs >=18.

After that, check that your */dalai/alpaca/models directory actually has the models.

Jul 25 '23 17:07 vulpcod3z