se-scraper

se-scraper copied to clipboard

Safe per IP Google limits?

3

Hi all, does anyone have up-to-date data for how many searches you can perform per IP per time period before getting blocked? We have a limited scraping need, and spare...

sf-steve

The problem was reported in this issue https://github.com/NikolaiT/se-scraper/issues/81. After checking html code of google's results I have noticed that query selector need to be adjusted to new html code provided...

przemek-nowicki

Duckduckgo wait_for_results selector doesn't work in case of no results

1

Hello It seems like the selector you are currently using to scrape the Duckduckgo Result Page is not properly working in the case that the search doesn't produce any results:...

PinkSheep

maxConcurrency = 5 if one of occur page close error, other page tab continue run ,but now only 4 pages run. i want to stop all when any page occur...

leadscloud

* Include the #70 * Better testing of the parser for shopping ads extraction * Fix a crash with some DOM with shopping ads * Configurable timeouts

HugoPoi

Parse multiple local html files instead of keywords

1

Hi, Thanks a lot for this great package. This is an awesome package and really worth all the starts it gets. I was wondering how can I feed multiple local...

pankajjha-cd

Error: Proxy output ip <proxy-ip> does not match with provided one

2

The error I have encountered is: "Error: Proxy output ip socks5://192.169.156.211:50479 does not match with provided one" I have been trying to run `for_the_lulz.js` with a proxy file, but I...

ceylanb

Is there a way to use auth with proxy?

2

For example `http://username:password@IP` It would be great if we can get this working

jaekunchoi

Feature Request: Add the possiblity to scrape the environmentally continuous search-engine Ecosia

1

The search-engine https://www.ecosia.org/ returns more or less the same searches as bing.com, but additionally donates money to plant a tree for every 45 searches done. Which means by scraping your...

tomwwabo

Can you provide me example of SERP that contains `right_info` ?

thangng48