progscrape Long Reddit titles should split on `|`, `.`, `:` or other punctuation

Long Reddit titles should split on `|`, `.`, `:` or other punctuation

Open mmastrac opened this issue 2 years ago • 2 comments

Long Reddit titles have never looked that great. We should be heuristically splitting them on punctuation where it makes sense.

Feb 23 '23 00:02 mmastrac

Experimentally (and not completely) implemented in https://github.com/mmastrac/progscrape/commit/71ae991d92f5c19d93d3e2314c100b5946bbf907

Feb 23 '23 22:02 mmastrac

Need to handle abbreviations:

https://gizmodo.com/drones-facial-recognition-us-air-force-realnetworks-1850163798

Feb 28 '23 04:02 mmastrac