keras-sd-serving
keras-sd-serving copied to clipboard
Do your have plan to Run TFLite models in Python or Java ?
Do your have plan to Run TFLite models in Python or Java ?
On-Device Deployment (w/ TFLite) - WIP
We have managed to convert SavedModel
s into TFLite models, and we are hosting them as below (thanks to @farmaker47):
- Text Encoder TFLite Model - 127MB
- Diffusion Model TFLite Model - 864MB
- Decoder TFLite Model - 99MB
These TFLite models have the same signature as the SavedModel
s, and all the pre/post operations are included inside. All of them are converted with float16 quantization optimize process. You can find more about how to convert SavedModel
s to TFLite
models in this repository.
TODO
- [ ] Implement SimpleTokenizer in JAVA and JavaScript
- [ ] Run TFLite models on Android and Web browser