FreeChat
FreeChat copied to clipboard
Extract model api into a separate SPM package
First of all I just wanted to say this is an awesome project! I downloaded and played with the app and I was blown away by the quality of the chat. It feels like GPT 3.5 but is completely free and private.
Until today I was completely oblivious to the fact that there were open source models that could match chatGPT and I was even more surprised that those models follow a similar format (GGUF) and are interchangeable.
From the Readme I can see that your goal is to "make open, local, private models accessible to more people". I was thinking of extracting the part of the app, where you can download and run any GGUF model into a separate SPM package. That would most certainly boost availability since more developers could integrate it. Would you be willing to collaborate on such a project? I can help with it if I get a little guidance.