web-llm
web-llm copied to clipboard
can I run in nodejs?
how can I make get-started run in nodejs?
According to the docs, they don't have a Node.js SDK yet. But meanwhile, you can use the Python Rest API Server, which gives you these endpoints, then access them in your Node.js (with node-fetch, for example) and implement all your app logic in JavaScript/TypeScript.
Would be nice to get this working with Deno as well, which had WebGPU until 1.31 (and may get gpu support back soon)
Would be nice to get this working with Deno as well, which had WebGPU until 1.31 (and may get gpu support back soon)
And it's back! Deno 1.39: The Return of WebGPU
Would be great to allow running in Node, at least for quick experimentations!
+1