proposals icon indicating copy to clipboard operation
proposals copied to clipboard

Google MLKit Digital Ink Plugin

Open andrew-lyons opened this issue 3 years ago • 0 comments

Plugin Request

Name: capacitor-mlkit-digitalink-plugin Package: @capacitor-community/capacitor-mlkit-digitalink-plugin

Platform(s)

  • IOS
  • Android
  • Others? Only have tested on IOS and Android mobile.

Existing Solutions

None

Description

Google has a suite of models that are publicly available to use. They provide documentation for writing native Java or Swift, but there are no Capacitor plugins made for them.

The digital ink plugin would allow users to write text onto a canvas element, and then have Google's model recognize what was drawn. This model has tons of language support, as well as an object recognition mode, where you can draw houses, cars, and tons more for recognition.

The company I work for allowed me to build out a capacitor plugin for the digital ink model, and I would like to:

  • Modify the structure to match any best practices for this community
  • Publish as a Capacitor community plugin

As an aside, if there is further interest, I would be glad to work on further MLKit plugins.

EDIT: Looks like there are a couple other solutions out there as mentioned in this thread

  • Vision: https://github.com/trancee/capacitor-google-mlkit-vision/
  • Language ID : https://github.com/hemangsk/capacitor-mlkit-language/

andrew-lyons avatar Mar 15 '22 02:03 andrew-lyons