langdata
langdata copied to clipboard
tesseract-ocr
Geresh and Gershayim are not included
https://github.com/tesseract-ocr/langdata/blob/106c9b31bea9d30814fc116cbcb9c267dee7df70/heb/heb.training_text
I couldn't find the Hebrew punctuation Geresh or Gershayim in the following text.
https://en.wikipedia.org/wiki/Geresh https://en.wikipedia.org/wiki/Gershayim
These were not widely used until pretty recently when a new keyboard layout was introduced.
Duplicate of https://github.com/tesseract-ocr/langdata/issues/82#issuecomment-320507304
Anyway, *.training_text files have not been updated for years. They are automatically generated from a web corpus.
Yes, with some hints from other files.
I don't remember the fine details right now.
https://github.com/tesseract-ocr/langdata/blob/master/ces/desired_characters
The opposite: https://github.com/tesseract-ocr/langdata/blob/master/ara/forbidden_characters
These lists are used in Ray's synthetic training data creation pipeline. As far as I know, the tesstrain.sh training process does not use them.
On Thu 5 Jul, 2018, 9:26 PM Amit D., [email protected] wrote:
I think 'desired_words' and 'forbidden_words' can also be used.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/tesseract-ocr/langdata/issues/130#issuecomment-402770232, or mute the thread https://github.com/notifications/unsubscribe-auth/AE2_o7IcVVjiarSlNnQ0hgEEvbAIH0Frks5uDjdHgaJpZM4VDvmc .
https://github.com/tesseract-ocr/tessdata/issues/62#issuecomment-319839971
theraysmith commented on Aug 3, 2017
FYI: The wordlists are generated files, so it isn't a good idea to modify them, as the modifications will likely get overwritten in a future training. To help prevent the ß/B confusion, the words that you want to lose from the wordlists need to go in langdata/lang/lang.bad_words.
So for undesired words a 'lang.bad_words' file should be used.
vie has 'alphabet' file: https://github.com/tesseract-ocr/langdata/blob/master/vie/alphabet