SpiderKeeper icon indicating copy to clipboard operation
SpiderKeeper copied to clipboard

admin ui for scrapy/open source scrapinghub

SpiderKeeper-2

This is a fork of SpiderKeeper. See changelog for new features

Latest Version Python Versions The MIT License

A scalable admin ui for spider service

Features

  • Manage your spiders from a dashboard. Schedule them to run automatically
  • With a single click deploy the scrapy project
  • Show spider running stats
  • Provide api
  • Integrated in scrapyd

Screenshot

job dashboard periodic job running stats

Getting Started

Installing

pip install spiderkeeper-2

Usage

  1. Run spiderkeeper

  2. Visit http://localhost:5000/

  3. upload egg file (make sure you started scrapyd server)

  4. Done & Enjoy it

  • api swagger: http://localhost:5000/api.html

## Authors

- *Initial work* - [DormyMo](https://github.com/DormyMo)
- *Fork author* - [kalombo](https://github.com/kalombos/)


## License

This project is licensed under the MIT License.

## Contributing

Contributions are welcomed!