Transformers.js integration / Typescript bindings

Open fosple opened this issue 2 months ago • 5 comments

Presentation of the new feature

Would be awesome if outlines-core could be integrated with Transformers.js via Typescript bindings & WASM support, now that web LLMs become more popular (e.g. google Gemma 3 270m or Metas MobileLLM-Pro). Is this planned?

Oct 19 '25 23:10 fosple

Not at the moment, but wed be happy to consider a PR that adds TS bindings :)

Oct 20 '25 13:10 rlouf

I'm on it :)

Oct 21 '25 16:10 fosple

Don't hesitate to open a draft PR soon so we can give you feedback as you go!

Nov 03 '25 09:11 rlouf

@rlouf Already have a working setup. Will open a PR once I'm back from vacation next week :)

Nov 03 '25 11:11 fosple

Awesome 🤩

Nov 03 '25 11:11 rlouf