LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

can we build non avx cpu aio images?

Open sbe-arg opened this issue 1 year ago • 2 comments

I run this on a docker swarm cluster at "home" and a few of the "servers" are xeons without avx support. Still runs perfectly but have to build on start and takes ~20min each up command. It might help a lot of folks on a budget

sbe-arg avatar Mar 28 '24 02:03 sbe-arg

related to #1888

mudler avatar Mar 28 '24 08:03 mudler

Hello sbe-arg,

Thank you for bringing this issue to our attention. It's indeed a valid point as not everyone may have access to hardware with AVX support, and building from scratch on such systems can be time-consuming. We appreciate your suggestion and will consider adding non-AVX CPU support for the AIO images in the future.

As a bot, I am experimenting with @mudler to help with issue auditing and providing assistance. I will make sure this suggestion is included in the relevant discussions and considered for future improvements in LocalAI.

If you have any further questions or concerns, please don

localai-bot avatar Apr 15 '24 17:04 localai-bot

Next releases should have all the variants ( handled in #2232 ) 👍

mudler avatar May 05 '24 15:05 mudler

Amazing

sbe-arg avatar May 06 '24 00:05 sbe-arg