polymath icon indicating copy to clipboard operation
polymath copied to clipboard
verified publisher icon dglazkov

Figure out text cleaning

Open dglazkov opened this issue 3 years ago • 0 comments

While importing text, text can be gnarly. We need a consistent way to clean it.

There are two places where that happens currently:

  1. in chunker.py: https://github.com/dglazkov/polymath/blob/main/convert/chunker.py#L43
  2. In main.py: https://github.com/dglazkov/polymath/blob/main/convert/main.py#L58

Let's figure out a single way.

dglazkov avatar Feb 05 '23 19:02 dglazkov