llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Will there ever be a GPU support for Apple Silicon?

Open alexcardo opened this issue 1 year ago • 0 comments

I really thank you for the possibility of running the model on my MacBook Air M1. I've been testing various parameters and I'm happy even with the 7B model. However, do you plan to utilize the GPU of M1/M2 chip? Thank you in advance.

alexcardo avatar Mar 15 '23 16:03 alexcardo