tagify icon indicating copy to clipboard operation
tagify copied to clipboard

Published 20 hours ago • verified publisher icon zoomio

Text segmentation is slow

Open waybackarchiver opened this issue 2 years ago • 4 comments

When processing large amounts of text, the three locations listed below perform poorly, perhaps more optimization is needed.

https://github.com/zoomio/tagify/blob/15b8055025ca47ffd852c14a47a2dc94d0a0da55/processor/html/html_processor.go#L374-L413

https://github.com/zoomio/tagify/blob/15b8055025ca47ffd852c14a47a2dc94d0a0da55/processor/text/text_processor.go#L46-L71

https://github.com/zoomio/tagify/blob/15b8055025ca47ffd852c14a47a2dc94d0a0da55/processor/md/md_processor.go#L245-L276

waybackarchiver avatar Sep 07 '22 13:09 waybackarchiver