'plot' in current.get_text().lower() doesn't match all relevant headers

[MarcinCiura]

In a similar project of mine, I used this regexp:

PLOT = [
    'Plot summary', 'Plot', 'Plot introduction',
    'Synopsis', 'Summary', 'Plot synopsis',
    'Overview', 'Story', 'Description' , 'Contents?'
]
HEADING_RE = re.compile(
    r'^ *=+\s*(%s)\s*=+' % '|'.join(PLOT),
    re.IGNORECASE | re.UNICODE | re.MULTILINE)

[markriedl]

Thanks for the suggestion. This might pick up some things that aren't novels, movies, or video games though. I try it out and see.

[MarcinCiura]

Right. That's why I used Wikipedia categories, which may be too big a change for your script. FWIW, here's the breakdown of headers in articles about novels: Plot summary 8466 Plot 5664 Plot introduction 1696 Synopsis 1492 Summary 636 Plot Summary 314 Plot synopsis 213 Overview 212 Story 124 Description 97 Contents 67 Content 53