Substack2Markdown icon indicating copy to clipboard operation
Substack2Markdown copied to clipboard

Too Many Requests

Open KWall24 opened this issue 10 months ago • 2 comments

Running this grabs the first few posts, but then substack complains of too many requests. Have to rerun the script to get any additional posts, and if there's too many it'll only be able to check that the files already exist before throwing too many requests again.

KWall24 avatar Feb 23 '25 15:02 KWall24

open substack_scraper.py add time.sleep(5) after essays_data.append( .... )

etemiz avatar Apr 27 '25 00:04 etemiz