chatcraft.org
chatcraft.org copied to clipboard
Explore transformers.js to see what we can leverage
There's a lot of amazing work happening in transformers.js, which lets you run Huggingface Models in the browser (see full docs). We should explore if there are any bits we could use here.
One issue to consider with these models is that you have to download and cache them, so we'd need to have a way to allow the user to opt-in to the downloads. Maybe we provide some kind of "add-on" style UI, where you can enable various features to run locally, and in then we kick off downloading these models to use.
Having these models stored locally would allow us to run some features for free, without doing API calls to remote AI models.
This issue is mainly about exploring this idea, and filing follow-ups to do specific work.