chatcraft.org icon indicating copy to clipboard operation
chatcraft.org copied to clipboard

wip: local llm support via window.ai

Open tarasglek opened this issue 7 months ago • 1 comments

Based on blog post in https://huggingface.co/blog/Xenova/run-gemini-nano-in-your-browser

Got incremental completions working with local chrome llm, just like upstream openai. Note this branch is a hack that calls local llm instead of doing a completion over network..So this chatcraft unusable with usual providers

tarasglek avatar Jul 11 '24 10:07 tarasglek