ggml icon indicating copy to clipboard operation
ggml copied to clipboard

Add Vulkan to cmake build

Open abetlen opened this issue 1 year ago • 5 comments

  • Adds a GGML_VULKAN option to cmake to allow building those sources into ggml
  • Adds the ggml_vk_generate_shaders.py and ggml-vulkan-shaders.hpp from llama.cpp to src/

abetlen avatar Feb 12 '24 00:02 abetlen

We should wait for https://github.com/ggerganov/llama.cpp/issues/5356 to see if they come up with a way to re-organize the Vulkan shaders

ggerganov avatar Feb 12 '24 08:02 ggerganov

Makes sense, no rush for me I was just experimenting with the new backends.

abetlen avatar Feb 12 '24 09:02 abetlen

https://github.com/ggerganov/llama.cpp/issues/5356 is closed for being inactive.

So, any updates?

foldl avatar May 15 '24 09:05 foldl

@ggerganov maybe for now I can just remove the auto-generated .hpp file and update the sync scripts. That should at least allow users to build with Vulkan by first running the python script to generate the shaders. How does that sound?

abetlen avatar May 17 '24 22:05 abetlen

@abetlen Ok, let's do that

ggerganov avatar May 19 '24 08:05 ggerganov

@ggerganov okay, I've removed the auto-generated file and updated the sync scripts. I also updated the ggml_vk_generate_shaders.py file to match the current ggml-vulkan files.

abetlen avatar May 24 '24 06:05 abetlen