EverTranslator icon indicating copy to clipboard operation
EverTranslator copied to clipboard

Text detection using TensorFlow

Open uomar8 opened this issue 2 years ago • 5 comments

In the past I suggested to use Opencv to detect text

but I founded a better way to do it using TensorFlow pre-trained EAST model

https://github.com/sayakpaul/Adventures-in-TensorFlow-Lite/blob/master/EAST_TFLite.ipynb

What do you think of this idea?

uomar8 avatar Jan 22 '23 17:01 uomar8

I think it is great to be implemented to an app, but the Google ML kit used in this application is also using a pre-trained TensorFlow model. I'll try to investigate how to use Tensorflow lite in an Android application.

firemaples avatar Jan 23 '23 14:01 firemaples

So the solution was already in the app 🥲

Is it possible to use Google ML kit to draw the select green rectangular automatically

uomar8 avatar Jan 23 '23 14:01 uomar8

So the solution was already in the app 🥲

Is it possible to use Google ML kit to draw the select green rectangular automatically

Yes, it is possible, but I'm not sure how to present the UI if there're several text regions on the screen.

firemaples avatar Jan 24 '23 11:01 firemaples

So the solution was already in the app 🥲 Is it possible to use Google ML kit to draw the select green rectangular automatically

Yes, it is possible, but I'm not sure how to present the UI if there're several text regions on the screen.

Here's is what I think

IMG_20230124_155926

1- hide language button because here it won't be used

2- new button to select the text by Text recognition by ML kit ( it will select by block)

3- Once user click inside the block will automatically draw the green box around the selected block :) and it could be edited same as it was drawn by swap two fingers

uomar8 avatar Jan 24 '23 13:01 uomar8

Or

So the solution was already in the app 🥲 Is it possible to use Google ML kit to draw the select green rectangular automatically

Yes, it is possible, but I'm not sure how to present the UI if there're several text regions on the screen.

Here's is what I think

IMG_20230124_155926

1- hide language button because here it won't be used

2- new button to select the text by Text recognition by ML kit ( it will select by block)

3- Once user click inside the block will automatically draw the green box around the selected block :) and it could be edited same as it was drawn by swap two fingers

Or this is by default and manual can be turned on in the settings so you click the block and it will run

uomar8 avatar Jan 24 '23 13:01 uomar8