Bug: fatal error: the cpu feature AVX was required at build time but isn't available on this system exiting process.

[KevinMind]

Contact Details

[email protected]

What happened?

Following the instructions on the readme, I downloaded the llava executable and ran the following code:

% mkdir -p src/mozilla/llamafile
% mv Downloads/llava-v1.5-7b-q4.llamafile src/mozilla/llamafile
% chmod +x src/mozilla/llamafile/llava-v1.5-7b-q4.llamafile
% ./src/mozilla/llamafile/llava-v1.5-7b-q4.llamafile
ape error: ./src/mozilla/llamafile/llava-v1.5-7b-q4.llamafile: prog mmap failed w/ errno 1
% ./src/mozilla/llamafile/llava-v1.5-7b-q4.llamafile
ape error: ./src/mozilla/llamafile/llava-v1.5-7b-q4.llamafile: prog mmap failed w/ errno 1
% ./src/mozilla/llamafile/llava-v1.5-7b-q4.llamafile
./src/mozilla/llamafile/llava-v1.5-7b-q4.llamafile: fatal error: the cpu feature AVX was required at build time but isn't available on this system
exiting process.

Moving the file to a new directory, make it executable and execute.

1. I ran into a permissions error from MacOS claiming it cannot run the file because it cannot verify the developer. I had to open system setttings to bypass that check (I'm not sure if it is covered but I didn't see it in the docs, could've missed it though)
2. after bypassing that check I got the above fatal error

Version

I couldn't get a version, see fatal error above. But I downloaded the file linked in the README.

What operating system are you seeing the problem on?

Mac

Relevant log output

fatal error: the cpu feature AVX was required at build time but isn't available on this system
exiting process.