OpenScraper
OpenScraper copied to clipboard
An open source webapp for scraping: towards a public service for webscraping
Hi, I've been sucessfully setting up an openscraper instance. Unfortunately, the spider always stops scraping after 15 results. After a bit of investigation, here is what seems to be the...
Hi @JulienParis, I'm testing [my own instance of OpenScraper](http://openscraper.jouannic.fr:8000/). So far, despite reading the documention, I've been unable to get any real data out of OpenScraper. I've defined a simple...
- [x] who are we and why ? - [x] contribute / roadmap - [ ] Legal - [x] technos used - [x] documentation : api Openscraper - [x] documentation...
- [ ] pie chart for whole dataset - [ ] horizontal stacked bar chart for spider X custom_fields/values - [ ] spiders X (reactive/follow/api) - [ ] spiders X...
Allowing the [client-side to seed random numbers](https://github.com/entrepreneur-interet-general/OpenScraper/blob/35252fc914d856f816bf2a50c6baeabb98035ac3/openscraper/base_handler.py#L1031-L1034) in the server side via an HTTP request doesn't seem like a good idea At best, it's useless because search results can easily...