gaianet-node
gaianet-node copied to clipboard
/bin/gaianet: line 569: 56621 Illegal instruction (core dumped) when starting LlamaEdge API Server in GaiaNet
Steps to Reproduce:
- Run
curl -sSfL 'https://github.com/GaiaNet-AI/gaianet-node/releases/latest/download/install.sh' | bash
- Run
source /root/.bashrc
- Run
/root/gaianet/bin/gaianet init
- Run
/root/gaianet/bin/gaianet start
Expected Result: The LlamaEdge API Server should start without issues.
Actual Result:
Error: Illegal instruction (core dumped)
Logs and System Information:
Output from `gaianet start` command:
root@220361:~# gaianet start
[+] Checking the config.json file ...
You already have a private key.
[+] Starting Qdrant instance ...
[+] Starting LlamaEdge API Server ...
Run the following command to start the LlamaEdge API Server:
wasmedge --dir .:./dashboard --env NODE_VERSION=0.2.2 --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf --nn-preload embedding:GGML:AUTO:nomic-embed-text-v1.5.f16.gguf rag-api-server.wasm --model-name Phi-3-mini-4k-instruct,Nomic-embed-text-v1.5 --ctx-size 4096,512 --batch-size 16,512 --prompt-template phi-3-chat,embedding --rag-policy system-message --qdrant-collection-name default --qdrant-limit 1 --qdrant-score-threshold 0.5 --web-ui ./ --socket-addr 0.0.0.0:8080 --rag-prompt "You are a tour guide in Paris, France. Use information in the following context to directly answer the question from a Paris visitor.\n----------------\n"
/root/gaianet/bin/gaianet: line 569: 56621 Illegal instruction (core dumped) nohup "${cmd[@]}" > $log_dir/start-llamaedge.log 2>&1
LlamaEdge API Server started with pid: 56621
Output from /root/gaianet/bin/gaianet --version
:
GaiaNet CLI Tool v0.2.2
Output from free -m
:
total used free shared buff/cache available
Mem: 9940 1082 221 2 8636 8540
Swap: 0 0 0
Output from uname -a
:
Linux 220361.xorek.cloud 5.15.0-75-generic #82-Ubuntu SMP Tue Jun 6 23:10:23 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Output from lscpu
:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 6
On-line CPU(s) list: 0-5
Output from ulimit -a
:
real-time non-blocking time (microseconds, -R) unlimited
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 39309
max locked memory (kbytes, -l) 1272444
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 39309
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
Please let me know if you need any further information. start-llamaedge.log