gaianet-node icon indicating copy to clipboard operation
gaianet-node copied to clipboard

/bin/gaianet: line 569: 56621 Illegal instruction (core dumped) when starting LlamaEdge API Server in GaiaNet

Open billionaire opened this issue 7 months ago • 7 comments

Steps to Reproduce:

  1. Run curl -sSfL 'https://github.com/GaiaNet-AI/gaianet-node/releases/latest/download/install.sh' | bash
  2. Run source /root/.bashrc
  3. Run /root/gaianet/bin/gaianet init
  4. Run /root/gaianet/bin/gaianet start

Expected Result: The LlamaEdge API Server should start without issues.

Actual Result: Error: Illegal instruction (core dumped)

Logs and System Information:

Output from `gaianet start` command:

root@220361:~# gaianet start
[+] Checking the config.json file ...

You already have a private key.
[+] Starting Qdrant instance ...
[+] Starting LlamaEdge API Server ...

    Run the following command to start the LlamaEdge API Server:

wasmedge --dir .:./dashboard --env NODE_VERSION=0.2.2 --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf --nn-preload embedding:GGML:AUTO:nomic-embed-text-v1.5.f16.gguf rag-api-server.wasm --model-name Phi-3-mini-4k-instruct,Nomic-embed-text-v1.5 --ctx-size 4096,512 --batch-size 16,512 --prompt-template phi-3-chat,embedding --rag-policy system-message --qdrant-collection-name default --qdrant-limit 1 --qdrant-score-threshold 0.5 --web-ui ./ --socket-addr 0.0.0.0:8080 --rag-prompt "You are a tour guide in Paris, France. Use information in the following context to directly answer the question from a Paris visitor.\n----------------\n" 

/root/gaianet/bin/gaianet: line 569: 56621 Illegal instruction     (core dumped) nohup "${cmd[@]}" > $log_dir/start-llamaedge.log 2>&1
    LlamaEdge API Server started with pid: 56621

Output from /root/gaianet/bin/gaianet --version:

GaiaNet CLI Tool v0.2.2

Output from free -m:

               total        used        free      shared  buff/cache   available
Mem:            9940        1082         221           2        8636        8540
Swap:              0           0           0

Output from uname -a:

Linux 220361.xorek.cloud 5.15.0-75-generic #82-Ubuntu SMP Tue Jun 6 23:10:23 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Output from lscpu:

Architecture:            x86_64
  CPU op-mode(s):        32-bit, 64-bit
  Address sizes:         48 bits physical, 48 bits virtual
  Byte Order:            Little Endian
CPU(s):                  6
  On-line CPU(s) list:   0-5

Output from ulimit -a:

real-time non-blocking time  (microseconds, -R) unlimited
core file size              (blocks, -c) 0
data seg size               (kbytes, -d) unlimited
scheduling priority                 (-e) 0
file size                   (blocks, -f) unlimited
pending signals                     (-i) 39309
max locked memory           (kbytes, -l) 1272444
max memory size             (kbytes, -m) unlimited
open files                          (-n) 1024
pipe size                (512 bytes, -p) 8
POSIX message queues         (bytes, -q) 819200
real-time priority                  (-r) 0
stack size                  (kbytes, -s) 8192
cpu time                   (seconds, -t) unlimited
max user processes                  (-u) 39309
virtual memory              (kbytes, -v) unlimited
file locks                          (-x) unlimited

Please let me know if you need any further information. start-llamaedge.log

billionaire avatar Jul 17 '24 15:07 billionaire