schedge icon indicating copy to clipboard operation
schedge copied to clipboard

WIP Switch scraper over to selenium

Open A1Liu opened this issue 1 year ago • 0 comments

Did not want to do this, but I guess we gotta. Selenium seems to be the best/only practical choice for human-in-the-loop scraping, which is what we need to do in order to pass the captcha and also avoid any captcha arms race nonsense.

Notes

  • Need to remove the scanner auto-closing stuff because when it reads from stdin, the scanner should not be closed by us

A1Liu avatar Aug 26 '23 18:08 A1Liu