keras-sd-serving icon indicating copy to clipboard operation
keras-sd-serving copied to clipboard

Do your have plan to Run TFLite models in Python or Java ?

Open caofx0418 opened this issue 1 year ago • 0 comments

Do your have plan to Run TFLite models in Python or Java ?

On-Device Deployment (w/ TFLite) - WIP

We have managed to convert SavedModels into TFLite models, and we are hosting them as below (thanks to @farmaker47):

These TFLite models have the same signature as the SavedModels, and all the pre/post operations are included inside. All of them are converted with float16 quantization optimize process. You can find more about how to convert SavedModels to TFLite models in this repository.

TODO

  • [ ] Implement SimpleTokenizer in JAVA and JavaScript
  • [ ] Run TFLite models on Android and Web browser

caofx0418 avatar Jul 30 '23 15:07 caofx0418