rune icon indicating copy to clipboard operation
rune copied to clipboard

Create an example for using the web runtime

Open Michael-F-Bryan opened this issue 3 years ago • 4 comments

Originally mentioned by @f0rodo in https://github.com/hotg-ai/rune/pull/261#issuecomment-903305619, we need to have some simple examples of using the web runtime in a real application.

I'm thinking our options are:

  • Make a command-line app which reads images/audio/whatever using the provided command-line arguments, similar to rune run (depends on #270)
  • Create a GUI app (e.g. using React and TypeScript/plain JS) which lets people upload a Rune to the browser and hooks up to your webcam #261

@Ge-te, I'm not really sure how to approach this one, do you have any suggestions?

Michael-F-Bryan avatar Aug 25 '21 17:08 Michael-F-Bryan

@Michael-F-Bryan is it even possible to run tflite in nodejs? or do we make tf.js runes as example?

Ge-te avatar Aug 25 '21 18:08 Ge-te

I'm in favor of command line

Ge-te avatar Aug 25 '21 18:08 Ge-te

I like the command-line option because it's easiest to implement and the the vast majority of the example will be about using the Rune runtime, whereas in a React app people would get distracted/overwhelmed by the code for making a functional UI.

That said, if we wanted to make a command-line version we'd need to comment out all TensorFlow Lite code until #270 is resolved... But I don't really want to do that because we won't be able to run Runes with TensorFlow Lite models in a browser, even though there is nothing stopping us.

Michael-F-Bryan avatar Aug 25 '21 18:08 Michael-F-Bryan

We need to do browsers cause we have users wanting that.

f0rodo avatar Aug 25 '21 23:08 f0rodo