WebSearcher
WebSearcher copied to clipboard
gitronald
Tools for conducting and parsing web search
Python version: `Python 3.8.0` WebSearcher==0.2.12 Hi, I'm running this simple python script saved as `searcher.py` ``` import WebSearcher as ws # Initialize crawler with defaults (headers, logs, ssh tunnels) se...
Bumps [idna](https://github.com/kjd/idna) from 2.10 to 3.7. Release notes Sourced from idna's releases. v3.7 What's Changed Fix issue where specially crafted inputs to encode() could take exceptionally long amount of time...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Think the title says it all. Really surprising behavior. ``` import WebSearcher as ws se = ws.SearchEngine() se.search('Zhiend') se.parse_results() print(se.results[6]) ``` This snipped would respond with ``` {'type': 'unknown', 'sub_type':...
Bumps [certifi](https://github.com/certifi/python-certifi) from 2023.7.22 to 2024.7.4. Commits bd81538 2024.07.04 (#295) 06a2cbf Bump peter-evans/create-pull-request from 6.0.5 to 6.1.0 (#294) 13bba02 Bump actions/checkout from 4.1.6 to 4.1.7 (#293) e8abcd0 Bump pypa/gh-action-pypi-publish from...
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.18 to 1.26.19. Release notes Sourced from urllib3's releases. 1.26.19 🚀 urllib3 is fundraising for HTTP/2 support urllib3 is raising ~$40,000 USD to release HTTP/2 support and...
Remove the line that resets self.params in the SearchEngine class (prepare_search). This change allows for the addition of parameters such as gl or hl, enabling more flexible and targeted searches.
Begin migrating library from requests to selenium. Added selenium calls (built on `undetected-chromedriver`) in `_conduct_chromedriver_search` and `_send_chromedriver_request`. Also added an additional step to launch chromedriver to facilitate debugging. test/selenium_test.py contains...
