search-engine-parser icon indicating copy to clipboard operation
search-engine-parser copied to clipboard

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

Results 21 search-engine-parser issues
Sort by recently updated
recently updated
newest added

Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/search_engine_parser/core/base.py", line 239, in get_results File "/usr/local/lib/python3.9/site-packages/search_engine_parser/core/base.py", line 151, in parse_result if not self._parsed_url: File "/usr/local/lib/python3.9/site-packages/search_engine_parser/core/engines/google.py", line 49, in parse_single_result h3_tag = r_elem.find('h3') AttributeError:...

bug

Yes i'm trying to add date range as shown here i need your help gys : ![Screen Shot 2020-09-28 at 18 48 31](https://user-images.githubusercontent.com/17418470/94467722-426ec580-01bb-11eb-84d4-a27c4b7bfbce.png)

enhancement

Apply techniques to prevent search engine scraper from being flagged as suspicious activity. Randomly cycle through browser headers for scraping

The Wikipedia engine is not as straight forward as the search engines with the related links having a different length from the titles and descriptions. Other nuances should be looked...

Query edx for results, cli option to download using edx-dl

It would be good, if there is a way to rotate user agent. This can help to achieve less flagging from google.

**Describe the bug** When I use search-engine-parser with flask, I get this error: `RuntimeError: There is no current event loop in thread 'Thread-2'.` **To Reproduce** Steps to reproduce the behavior:...

bug

**Describe the bug** There is is a Continuous Integration Test Case Suite which is great but it fails displaying ![grafik](https://user-images.githubusercontent.com/1336221/203234932-c86cf33f-6394-4b67-b13c-c13adc632c05.png) in the public documentation e.g. on https://pypi.org/project/search-engine-parser/ **To Reproduce** Steps...

bug

by default set `safe = "active"` inorder to turnoff, one can add the parameter in kwargs as `safe = "off"` usage: ```python search_args = ('hello world', 1) gsearch = GoogleSearch()...