Aravind Ceyardass
Aravind Ceyardass
There are no other messages. ``` load_tensors: CPU_Mapped model buffer size = 236.47 MiB load_tensors: Vulkan0 model buffer size = 1564.62 MiB ............................................................................ llama_init_from_model: n_seq_max = 1 llama_init_from_model: n_ctx =...
> It's broken tests, you built with `-DGGML_VULKAN_RUN_TESTS=ON`, which is currently broken. But regardless of that, it should never be enabled on a build you want to use, it's just...
I think they dropped OpenCL support on discrete/iGPUs last year. It is supported only on ARM architectures now AFAIK.
> I've found that Vulkan killed performance compared to OpenCL. A transcription result that took only 13 seconds with OpenCL now takes 40+ with Vulkan, but it's still faster than...