archive-query-log
archive-query-log copied to clipboard
Create list of previous SERP scraping resources
The list should focus on differences and similarities as well as restrictions (e.g., API key required). Some tools and datasets to start with include (unordered):
- https://github.com/MarioVilas/googlesearch
- https://github.com/eliasdabbas/advertools (https://advertools.readthedocs.io/en/master/advertools.serp.html, https://www.dashboardom.com/google-serp)
- https://www.kaggle.com/eliasdabbas/datasets?search=engine
- https://developers.oxylabs.io/scraper-apis/serp-scraper-api
- https://serpapi.com/search-api
- https://help.zutrix.com/en/article/get-serp-results-1tvh8i0/
- https://app.zenserp.com/documentation
- https://serpstack.com/documentation
- https://github.com/dimitryzub/scrape-google-scholar-py
- https://github.com/gitronald/WebSearcher
- https://app.outscraper.com/api-docs
- https://github.com/theblackcat102/local-google-serp
- https://serp-spider.github.io/documentation/search-engine/google/
The list could probably just be added to the readme.