chatcraft.org
chatcraft.org copied to clipboard
wip: local llm support via window.ai
Based on blog post in https://huggingface.co/blog/Xenova/run-gemini-nano-in-your-browser
Got incremental completions working with local chrome llm, just like upstream openai. Note this branch is a hack that calls local llm instead of doing a completion over network..So this chatcraft unusable with usual providers