Illegal instruction (core dumped)

[itz-coffee]

I am unable to use llama-node on a xeon E5-2690 v2, I get the error:

Illegal instruction (core dumped)

I am assuming it is because it doesn't support AVX2, as llama-node works on my i7 12700F. Is there any way to get it to work?

[hlhr202]

I am unable to use llama-node on a xeon E5-2690 v2, I get the error:

Illegal instruction (core dumped)

I am assuming it is because it doesn't support AVX2, as llama-node works on my i7 12700F. Is there any way to get it to work?

which nodejs version and backend you are using?

[itz-coffee]

v18.16.0 and llama-cpp, sorry forgot to mention

[hlhr202]

@itz-coffee I m not going to support disable AVX2 by default (since theres are only very old cpus dont support AVX2) You can change the build.rs in llama-sys here just follow the CMakeList.txt https://github.com/ggerganov/llama.cpp/blob/master/CMakeLists.txt and OFF the AVX2 support.

Also I would assume that without AVX2, you inference probably very slow.

[hlhr202]

This issue is definitely caused by AVX2 instruction. I may provide a self build feature on rust side in the future for easier compilation.