crawlpy
crawlpy copied to clipboard
Published
20 hours ago •
cytopia
cytopia
Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk
Results
1
crawlpy issues
Sort by
recently updated
recently updated
newest added
# Roadmap ## v0.4 - [ ] First parse JS, then crawl (possibly via phantomJS) ## v0.3 - [ ] Make self-contained spider ## v0.2 [Release v0.2](https://github.com/cytopia/crawlpy/tree/v0.2) - [X] ~~Be...
