SeekingAlphaWebScrape icon indicating copy to clipboard operation
SeekingAlphaWebScrape copied to clipboard

seekingalpha anti scraping measures

Open bencolo opened this issue 4 years ago • 1 comments

I am really impressed by your sophicated scraper for seekingalpha. It exactly provides the output that could be very useful for my research. Unfortunately, it does not work anymore as seekingalpha uses captcha and other anti scraping measures. I have tried to modify my chromedriver and also start some measures to avoid being detected for using selenium but nothing worked. Do you have any idea how to utilize this genius code again? Maybe it helps to integrate some code lines which use the login credentials of a free 14 days premium trial.

bencolo avatar Jun 27 '21 20:06 bencolo

@bencolo @RCJansonVTFL depending upon if this repo is still active or not I'm working with a few people to expand webscraping tools and there are methods to fix or update the code.

What is written now is a very good start and I would like to expand upon it as I'm managing a similar alphavantage repo and would like to collaborate to get a tool that handles multiple issues.

datatalking avatar Aug 16 '22 16:08 datatalking