Results 4 repositories owned by LxL

files

416
Stars
71
Forks
Watchers

Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects

logparser

84
Stars
21
Forks
Watchers

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

scrapyd-cluster-on-heroku

122
Stars
94
Forks
Watchers

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO :point_right:

scrapydweb

3.0k
Stars
548
Forks
Watchers

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right: