fastLLaMa icon indicating copy to clipboard operation
fastLLaMa copied to clipboard

Port llama.cpp openCL support to fastllama?

Open stduhpf opened this issue 2 years ago • 0 comments

Llama.cpp somewhat recently added support of openCL acceleration, enabling hardware-acelleration on AMD GPUs. Could it be possible to do the same thing?

stduhpf avatar Jun 02 '23 12:06 stduhpf