ohmplatform
Task list for Intel Mac support?
Hi.
I hope you are having a great new year so far.
Is there a task list for what is needed for Intel Mac support? Maybe some of us could help?
Thanks in advance.
Why? They have been replaced by the shitty ARM-based proprietary stuff. Other than that, follow the Linux instructions.
"It didn't work". That's not much to go on. What response do you get. Other than that, Mac is really not optimal for AI. I guess an Intel based system is better though.
You should try the alpaca.cpp method. It's a lot better anyway. Read the readme, there's a link. It's command line based and you can adjust settings, which you cannot in the gui.
While I appreciate the concern, fixing the errors of the build on an Intel Mac is not pre se the concern as much as identifying what needs the project has with respect to getting the code to work on an Intel Mac in general. While that statement might sound like a distinction without a difference, I am talking about the larger picture beyond a simple build. The readme suggests the possibility of a larger set of needs beyond successfully building on an Intel Mac, which is why I asked for the task list.
To my understanding, the only requirements for a successful build are those listed.
If it will not build on an Intel Mac, it may be because it's simply not possible. That said, the app is really only a graphical shell to the alpaca.cpp code which you can build on a Mac. This code is useless in itself and only provides a fancy browser window for entering requests. The same can be achieved by running the chat CLI program with the -i argument.
I would do that instead, since this method also allows adjustments. It even better, I would use llama.cpp which enables larger models. I use that with the Alpaca 13b q4 model, which is a lot better.
It still only has s response limit of around 3 KB og you ask it to write a story, though, which is the main drawback of this model.