confusables icon indicating copy to clipboard operation
confusables copied to clipboard

Fix issues with long strings

Open varun-dhar opened this issue 3 years ago • 1 comments

confusables.normalize() has issues with long strings, especially numbers. It creates large lists that consume a great deal of memory (froze my pc lol). These changes allow it to be more tolerant of long strings by ignoring alphanumeric ascii characters. I've also done some minor code cleanup. The testcases I noticed to be causing this issue were discord links, eg: https://discord.com/channels/00000000000000000/00000000000000000/00000000000000000 https://cdn.discordapp.com/attachments/00000000000000000/00000000000000000/video0.mp4

varun-dhar avatar Jul 05 '21 22:07 varun-dhar

The code in #36, or a version of it, might also assist with this issue.

lazydog2 avatar Jan 12 '24 03:01 lazydog2