llamafile icon indicating copy to clipboard operation
llamafile copied to clipboard

Application Integration Guide/Documentation

Open mofosyne opened this issue 6 months ago • 0 comments

In this issue https://github.com/Mozilla-Ocho/llamafile/issues/165 I had a thought about features that we may not want to integrate necessarily in to llamafiles because it is not as generalisable, but would be good to encourage best practices as well as provide relevant code examples on getting a quickstart on using the API etc... or where to find relevant resources to best approach it.

Note that this is separate from a documentation targeting those who want to package up the models (on that thread... do we yet have a package manager like approach for AI models or is that essentially hugging face here?)

e.g. placing llamafiles into a common location... like for example ~/llamafile/models/?

I am not sure what's the most typical file name for such doc... would it be APPLICATIONS.md ? I'm afraid I might end up bikeshedding on this, so I hope other projects has a similar file that I could just follow the naming scheme of.


Quick search on relevant issue tickets that this could include:

  • https://github.com/Mozilla-Ocho/llamafile/issues/167 : integration with vscode
    • Guide on integrating with js based plugins like dendron (vscode plugin), vscode, obsidian, etc...

mofosyne avatar Jan 03 '24 14:01 mofosyne