gpt4all-chat icon indicating copy to clipboard operation
gpt4all-chat copied to clipboard

Linux: illegal hardware instruction. (older hardware not supported yet)

Open JayPhil2k19 opened this issue 1 year ago • 6 comments

So everything downloaded and installed correctly. But when I went to run the chat binary I got this error message:

QML debugging is enabled. Only use this in a safe environment. gptj_model_load: loading model from 'ggml-gpt4all-j.bin' - please wait ... gptj_model_load: n_vocab = 50400 gptj_model_load: n_ctx = 2048 gptj_model_load: n_embd = 4096 gptj_model_load: n_head = 16 gptj_model_load: n_layer = 28 gptj_model_load: n_rot = 64 gptj_model_load: f16 = 2 [1] 1035799 illegal hardware instruction (core dumped) ./chat

I'm running arch linux. Kernel Version: 6.2.10

Any help would be appreciated, thank you!

JayPhil2k19 avatar Apr 15 '23 02:04 JayPhil2k19

Never seen that... What type of hardware / chipset do you have?

manyoso avatar Apr 15 '23 03:04 manyoso

I have fairly old machine.

CPU: AMD A8-3800 APU GPU:AMD ATI Radeon HD 6550D RAM: 8GB

JayPhil2k19 avatar Apr 15 '23 03:04 JayPhil2k19

GPT 4: According to the error message, you may be experiencing an issue with hardware support for instructions or an incompatibility between your CPU and certain instructions used by the application. To identify and resolve the problem, try the following steps:

Verify that your processor supports AVX/AVX2 instructions. You can do this by running the command lscpu | grep -E 'avx|avx2' in the terminal. If there is no mention of AVX/AVX2 in the output, your processor may not be compatible with the instructions being used.

Update your system to the latest package and kernel versions by running the commands:

Copy code sudo pacman -Syu sudo reboot Install all required dependencies for the application in question. You may have missed some of them or installed the wrong version. Make sure you have the latest versions of all libraries and components installed.

Check for bugs and compatibilities in the application code. You may need to contact developers or the community for help or to find fixes.

If possible, try running the application on another computer or an AVX/AVX2-enabled virtual machine to see if the problem is really related to hardware support.

amsator avatar Apr 15 '23 05:04 amsator

I have same issue on Ubuntu 22.04

invdj avatar Apr 15 '23 06:04 invdj

Thank you very much for your suggestions! I ran the command and came it back with a negative return, so I'm going to attempt to use a virtual machine as you suggested. I also have an old mac I can give this a try on!

JayPhil2k19 avatar Apr 15 '23 16:04 JayPhil2k19

issue "Illegal instruction (core dumped)" with Arch running on Intel i5-2520M CPU. Solved by compiling the code instead of running the released binary.

buddyFloreale avatar Apr 21 '23 01:04 buddyFloreale

Avx only now supported

manyoso avatar May 09 '23 16:05 manyoso