voltaserve icon indicating copy to clipboard operation
voltaserve copied to clipboard

Auto detect images with text and their language + UI settings to auto run Insights

Open cheney-yan-ifl opened this issue 1 year ago • 4 comments

Currently the app only supports search in documents. Expecting OCR support for images.

cheney-yan-ifl avatar Jul 06 '24 07:07 cheney-yan-ifl

@cheney-yan-ifl to make the images searchable, you have to enable the "Insights" feature, here in the demo video it shows how to do it (I already moved the video to the exact location): https://youtu.be/Uf3EWb2hDfs?t=352 Just make sure you choose the correct language when enabling the "Insights". Give it a try and let me know if it works for you.

bouassaba avatar Jul 06 '24 15:07 bouassaba

Thanks. It works. It will be convenient if there's a global setting for automatically turn on insights for images.

cheney-yan-ifl avatar Jul 07 '24 07:07 cheney-yan-ifl

@cheney-yan-ifl the problem is that there is no efficient way to automatically detect:

  1. if an image has text
  2. if yes - what's the language of that text?

EDIT: That would involve training ML models on a massive amount of images to be able to get this working at an acceptable success rate.

bouassaba avatar Jul 07 '24 14:07 bouassaba

I will rename this GitHub to "automatically detect images with text and their language", mark it as a "feature" and keep this open for research.

bouassaba avatar Jul 07 '24 16:07 bouassaba