npx dalai serve submitted, no response received

[luisvolkyazul]

I am able to access the web interface and upon submitting the prompt I only get the results below:

npx dalai serve mkdir /home/luis/dalai Server running on http://localhost:3000/

query: { method: 'installed', models: [] } modelsPath /home/luis/dalai/alpaca/models { modelFolders: [ '7B' ] } exists 7B modelsPath /home/luis/dalai/llama/models { modelFolders: [ '7B' ] } query: { seed: -1, threads: 4, n_predict: 200, top_k: 40, top_p: 0.9, temp: 0.8, repeat_last_n: 64, repeat_penalty: 1.3, debug: false, models: [ 'alpaca.7B' ], model: 'alpaca.7B', prompt: 'Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n' + '\n' + '### Instruction:\n' + 'Write a one paragraph explanation about the origin of the car.\n' + '\n' + '### Response:\n', id: 'TS-1680645522125-46087' } { Core: 'alpaca', Model: '7B' } exec: /home/luis/dalai/alpaca/main --seed -1 --threads 4 --n_predict 200 --model models/7B/ggml-model-q4_0.bin --top_k 40 --top_p 0.9 --temp 0.8 --repeat_last_n 64 --repeat_penalty 1.3 -p "Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

Instruction:

Write a one paragraph explanation about the origin of the car.

### Response: " in /home/luis/dalai/alpaca

---

After this it just hangs and nothing happens. Any pointers will be appreciated!

[Th1nhNg0]

same issue

[Likeke]

Yeah, same problem here

[RealWorld-fi]

same

[mlnima]

same

[maowenz]

same

[bendeguzszkalka]

Do you have anything in the models folder?

[luisvolkyazul]

Do you have anything in the models folder?

Hi Tesztalany, yes. I have 7B. Thanks for the question. Let me know if this is incorrect. Thank you.

[Jiayang-21]

Same issue, runs ok with 7B but failed on 13B

[noscene]

same issue here, i just replace the model file from other url, the it works

curl -o ggml-model-q4_0.bin -C - https://gateway.estuary.tech/gw/ipfs/QmQ1bf2BTnYxq73MFJWu1B7bQ2UD6qG7D7YDCxhTndVkPC

[leewonsub]

Same issue.....somebody help me.. please. my boss angery....