LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard
Published 2 weeks ago • verified publisher icon mudler

Build vulkan image for arm64

Open docjyJ opened this issue 6 months ago • 2 comments

Is your feature request related to a problem? Please describe.

Vulkan images are compiled for amd64 only. Vulkan is a cross-platform API and is supported by several ARM GPUs.

Describe the solution you'd like

Build vulkan images for amd64 and arm64.

Describe alternatives you've considered

Additional context

Vulkan support for arm can solve these issues:

  • https://github.com/mudler/LocalAI/issues/2205
  • https://github.com/mudler/LocalAI/issues/4205

docjyJ avatar Jul 02 '25 00:07 docjyJ

Jetson Nano supports Vulkan https://developer.nvidia.com/embedded/vulkan

docjyJ avatar Jul 02 '25 20:07 docjyJ

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Oct 04 '25 02:10 github-actions[bot]