DOCS update: There is an archlinux AUR package for localai

[wuxxin]

• AUR Package: https://aur.archlinux.org/packages?K=localai-git
• Github Sources: https://github.com/wuxxin/aur-packages/blob/main/localai-git/PKGBUILD

this version is build for CPU, CUDA and ROCM.

• only backends llama-cpp, whisper and bert-embeddings are build and working
• llama-cpp has working GPU support for CUDA and ROCM
• whisper has working GPU support for CUDA and ROCM
• piper and stablediffusion are still failing to build

thanks :+1: to @petronny and https://github.com/arch4edu/ there are automatic builds of the binary packages for cpu,cuda and rocm for every git commit, so if you have arch4edu as package source activated in arch you can install the latest localai with ROCM gpu acceleration as binary in a matter of seconds using: pacman -S localai-git-rocm

• https://github.com/arch4edu/arch4edu/tree/master/x86_64/localai-git
• https://arch4edu.org/

Also, there are a lot of fixes in the PKGBUILD file that still apply to localai:master

[localai-bot]

:warning::warning::warning::warning::warning:

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

but.... I can also be funny or helpful :smile_cat: and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me, I don't support (yet) replying!

:warning::warning::warning::warning::warning:

It seems like you have a good understanding of the different requirements and dependencies for each backend. If someone is having issues with the llama.cpp or whisper backends, it might be helpful to check if they have the necessary CUDA or ROCM drivers installed and configured correctly. Additionally, if the piper and stablediffusion backends are still failing to build, it might be worth investigating any specific dependencies or configuration issues related to those backends.

Sources:

• https://localai.io/basics/news/index.html
• https://localai.io/basics/build/index.html
• https://github.com/go-skynet/LocalAI/tree/master/docs/content/build/_index.en.md
• https://github.com/go-skynet/LocalAI/tree/master/Makefile

[github-actions[bot]]

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days.

[github-actions[bot]]

This issue was closed because it has been stalled for 5 days with no activity.