Jpy

first test for managing infinite_scroll : https://github.com/entrepreneur-interet-general/OpenScraper/commit/fe582d0dfe9c8f7c8f1c9091365cb36f8e18e060

Before anything : I have to merge the Selenium branch to the master before you'd use the following advices and comments (or you can use the Selenium branch for now)......

Let me know if those brief comments help you, in that case I'll begin to add those in the `tutos` section

the master branch works but doesn't include neither selenium nor API scraping... so some fields like `api_pagination` aren't present in the master branch (for now)

@thibault I just added in prod some documentation concerning : - the API : http://www.cis-openscraper.com/infos/api - how to use OpenScraper : http://www.cis-openscraper.com/infos/tuto

And I merged selenium branch into master

For now the only way to get feedbacks while scrapping is to run it with the terminal open (for instance having your local instance run from the terminal and checking...

@thibault I'm also trying with my own instance but get no results from "http://www.ademe.fr/actualites/appels-a-projets "... same as you :( ... Trying to figure out what is the bug... I tried...

... I added the `quotestoscrap` scraper and its working fine... It must be something related to the ademe website (or the scrapy settings because requests are doing fine)... I tried...

@thibault I think I got it !! There is something going wrong with the scrapy settings... I commented the line 139 in `masterspider.py` file : this one --> `settings.set( "RANDOMIZE_DOWNLOAD_DELAY"...