Searching for Persian and Arabic words does not return anything

Open NabiKAZ opened this issue 2 years ago • 2 comments

For Farsi or Arabic words, the autocomplete is fine, but nothing appears in the search results. It seems that there is a problem in url decode. For example: "سلام"

Jul 14 '23 14:07 NabiKAZ

Currently, the main focus of data collection is on English and Chinese groups and channels. In a few days, I will start collecting groups and channels in various languages.

Jul 15 '23 00:07 tgscan-dev

Maybe caused by tokenizer, https://github.com/tgscan-dev/tgscan/issues/5 . it works now!

Jul 17 '23 07:07 tgscan-dev