LocalAI
LocalAI copied to clipboard
mudler
chore(vulkan): enable arm64 image builds
Description
This PR fixes #5778
Notes for Reviewers
This is first an attempt to see if CI builds against vulkan on arm64
See https://github.com/docker/build-push-action/issues/671 regarding using arm64 native runners for multiplatform builds. Signed commits
- [ ] Yes, I signed my commits.
Deploy Preview for localai ready!
| Name | Link |
|---|---|
| Latest commit | 2aed98d14b9afd23b2033d726e88563874daa5da |
| Latest deploy log | https://app.netlify.com/projects/localai/deploys/68d97f46212c2d000854c887 |
| Deploy Preview | https://deploy-preview-5780--localai.netlify.app |
| Preview on mobile | Toggle QR Code...Use your smartphone camera to open QR code link. |
To edit notification comments on pull requests, go to your Netlify project configuration.
![netlify[bot] avatar](https://avatars.githubusercontent.com/in/13473?v=4 "Published by a pub.dev verified publisher"){kind=small}
Hey
Unfortunately vulkan-sdk is not precompiled for arm64. It must be compiled manually...
There also are not plans to update our Ubuntu packages for ARM. Again users can use the tarball for this situation. See https://vulkan.lunarg.com/issue/view/654594145df11238996e13fe
Hey
Unfortunately
vulkan-sdkis not precompiled for arm64. It must be compiled manually...There also are not plans to update our Ubuntu packages for ARM. Again users can use the tarball for this situation. See https://vulkan.lunarg.com/issue/view/654594145df11238996e13fe
appreciated, thanks for the heads up, will give it a shot later in the day, but I see already the CI is emitting core dumps, seen that already in ubuntu images. Might need use of our self-hosted runners for this or try to rebase and work out https://github.com/mudler/LocalAI/pull/5553 first.
It's great to see that it's marked on the roadmap. I'm really looking forward to running LocalAI on my RK3588. If you need any help, don't hesitate to ask.
@mudler any update here? What is missing to merge this?
I didn't had time into looking at this again, but what's missing is actually consuming and installing the vulkan-sdk during the build process. The problem is that, if we compile it along the process it will take too much time out and the CI will eventually fail - we need to find a pre-compiled version. I was having a look at https://github.com/mudler/vulkan-sdk-arm but paused since then
I don't understand why they don't offer a compiled version for ARM.
Neither do I :( it would make things much more simpler...
In any case, will take a stab at it again as soon as 3.8 is out. There are many feature in the pipeline for 3.8 that kept me busy!