chatcraft.org icon indicating copy to clipboard operation
chatcraft.org copied to clipboard

Explore transformers.js to see what we can leverage

Open humphd opened this issue 1 year ago • 3 comments

There's a lot of amazing work happening in transformers.js, which lets you run Huggingface Models in the browser (see full docs). We should explore if there are any bits we could use here.

One issue to consider with these models is that you have to download and cache them, so we'd need to have a way to allow the user to opt-in to the downloads. Maybe we provide some kind of "add-on" style UI, where you can enable various features to run locally, and in then we kick off downloading these models to use.

Having these models stored locally would allow us to run some features for free, without doing API calls to remote AI models.

This issue is mainly about exploring this idea, and filing follow-ups to do specific work.

humphd avatar Jan 03 '24 15:01 humphd