dRAT3
dRAT3
I do have 2 cpus maybe that has something to do with it?
``` Starting program: /home/barry/evo/ggllm.cpp-1/build/bin/falcon_main -t 11 -m /home/barry/evo/falcon/wizard-falcon40b.ggmlv3.q4_K_M.bin -p This\ is\ your\ first\ run\ here\ what\ do\ you\ wanna\ say\? -n 512 [Thread debugging using libthread_db enabled] Using host libthread_db...
Oh thx mate first time using gdb :+1: ``` Program received signal SIGILL, Illegal instruction. 0x0000555555563573 in gpt_params::gpt_params (this=0x7fffffffc880) at /home/barry/evo/ggllm.cpp-1/examples/falcon_common.h:23 23 struct gpt_params { (gdb) bt #0 0x0000555555563573 in...
going to spray some prints in the `get num_physical_cores` see at what line it breaks exactly
Built like this: `rm -rf build && mkdir build && cd build && cmake -DGGML_CUBLAS=1 -DLLAMA_AVX=OFF -DLLAMA_AVX2=OFF .. && cmake --build . --config Release` Still core dumps on illegal instruction
[cpuid.txt](https://github.com/cmp-nct/ggllm.cpp/files/11790499/cpuid.txt)