use proxy for selenium

[amirdaaee]

Duplicates

• [X] I have searched the existing issues

Summary 💡

Currently, the read_webpage function within web_selenium command lacks built-in support for using proxy servers. This feature request proposes adding functionality to enable users to specify a proxy server when utilizing the read_webpage function.

Examples 🌈

No response

Motivation 🔦

• Scraping geo-restricted websites: By leveraging proxies located in different regions, users can access and scrape data from websites that might be restricted based on geographical location.

• Enhanced privacy: Proxies can anonymize the user's IP address, potentially improving privacy while scraping data.

• Rotational scraping: Utilizing a pool of proxies allows for distributing scraping requests across different IP addresses, reducing the risk of being flagged by websites.