LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

arm64 raspberry pi docker image

Open maxvaneck opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe. it would be nice for people to be able to run localai on their surplus of raspberry pi's so my proposal is for a arm64 docker image especially for people tinkering with a turing pi cluster even though it would be slow as hell maybe even run it using vulkan since the pi gpu driver is now vulkan conformant . maybe even a jetson nano specific build

Describe the solution you'd like an arm64 docker build with optional vulkan support in time maybe if feasible

Describe alternatives you've considered gpus and cpu's are expensive and guzzle power

Additional context x gpu's and cpu's are expensive and a raspberry pi is almost universally part of someones tinker environment

maxvaneck avatar Nov 20 '24 10:11 maxvaneck

pi's do not have the computing power to run localai, mine can barely run a web browser in 720p.

Finnsflyer avatar Dec 26 '24 09:12 Finnsflyer

a spesific build for jetson nano exists https://localai.io/docs/reference/nvidia-l4t/

docjyJ avatar Jul 02 '25 20:07 docjyJ

in that case case closed i guess at least for the jetson nano

maxvaneck avatar Jul 03 '25 07:07 maxvaneck