local llm

[si-open]

Please add lmstudio.ai local or my favorite https://github.com/Mozilla-Ocho/llamafile

This is good for my own code

[tidbeck]

There are a lot of plugins to run local models https://llm.datasette.io/en/stable/plugins/directory.html#local-models including llamafile.