rig icon indicating copy to clipboard operation
rig copied to clipboard

feat: add local model support and examples

Open vacekj opened this issue 2 months ago • 10 comments

this PR adds a client impl for calling local models, such as ollama and lm studio. it also duplicates some examples, such as simple chat, embeddings and tools calls. it also adds a collab example with local models, that demonstrates models working together to find a good prompt for themselves.

I have verified all of the examples work for me, on an M1 Max w/ ollama latest.

vacekj avatar Dec 10 '24 13:12 vacekj